2020-04-28T12:24:33.901 INFO:root:teuthology version: 1.0.0-8b924f7 2020-04-28T12:24:33.902 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.gfwezkja.tmp -- --verbose --lock --description rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} --name teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi --block --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4989993 2020-04-28T12:24:33.947 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:24:34.010 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4989993 branch: octopus description: rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml} email: ceph-qa@ceph.io first_in_suite: false job_id: '4989993' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: '8.0' overrides: admin_socket: branch: octopus ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 rgw max chunk size: 4194304 rgw obj stripe size: 6291456 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1999 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd fast shutdown: false osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true rgw.client.1: ca: root client: client.1 embed-key: true root: client: client.0 cn: teuthology install: - client.0 - client.1 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 client.1: ssl certificate: rgw.client.1 compression type: random ec-data-pool: true frontend: civetweb storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: octopus sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 sleep_before_teardown: 0 suite: rgw suite_branch: octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph_octopus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 tasks: - install: null - ceph: null - openssl_keys: null - rgw: client.0: null - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_rgw_throttle.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 teuthology_branch: py2 tube: smithi verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.18556 2020-04-28T12:24:34.010 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_octopus/qa; will attempt to use it 2020-04-28T12:24:34.010 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks 2020-04-28T12:24:34.011 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-28T12:24:34.012 INFO:teuthology.task.internal:Checking packages... 2020-04-28T12:24:34.047 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'a8c125c7d78f5cd973863993d258cd717ade4c99' 2020-04-28T12:24:34.048 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-28T12:24:34.048 INFO:teuthology.packaging:ref: None 2020-04-28T12:24:34.048 INFO:teuthology.packaging:tag: None 2020-04-28T12:24:34.048 INFO:teuthology.packaging:branch: octopus 2020-04-28T12:24:34.048 INFO:teuthology.packaging:sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:24:34.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2020-04-28T12:24:34.483 INFO:teuthology.task.internal:Found packages for ceph version 15.2.1-150.gfcb0536 2020-04-28T12:24:34.484 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-28T12:24:34.493 INFO:teuthology.task.internal:no buildpackages task found 2020-04-28T12:24:34.494 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-28T12:24:34.521 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-28T12:24:34.521 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:24:34.563 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-28T12:24:44.578 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:24:54.599 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:25:04.617 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:25:14.636 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-28T12:25:24.653 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_teuthology@teuthology', 'description': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4989993', 'machine_type': 'smithi'} 2020-04-28T12:25:24.671 DEBUG:teuthology.lock.ops:locked ubuntu@smithi197.front.sepia.ceph.com, ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:25:24.736 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:25:24.930 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.0 2020-04-28T12:25:24.937 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 8.0 2020-04-28T12:25:25.392 INFO:teuthology.orchestra.console:Power off smithi066 2020-04-28T12:25:25.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:25:25.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:25.438 INFO:teuthology.orchestra.console:Power off smithi197 2020-04-28T12:25:25.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:25:25.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:29.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:29.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:33.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:33.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:33.774 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2020-04-28T12:25:33.875 INFO:teuthology.orchestra.console:Power on smithi066 2020-04-28T12:25:33.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:25:33.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:37.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:37.915 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2020-04-28T12:25:37.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:38.017 INFO:teuthology.orchestra.console:Power on smithi197 2020-04-28T12:25:38.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:25:38.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:42.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:42.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:42.242 INFO:teuthology.orchestra.console:Power on for smithi066 completed 2020-04-28T12:25:42.342 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2020-04-28T12:25:46.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi197.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:25:46.376 INFO:teuthology.orchestra.console:Power on for smithi197 completed 2020-04-28T12:25:46.477 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish 2020-04-28T12:28:14.090 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:17.985 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:23.152 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:27.060 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:32.208 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:36.112 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:41.264 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:45.168 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:50.320 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:54.228 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:28:59.382 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:29:03.280 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:29:08.469 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:29:12.347 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:29:21.427 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:29:53.139 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:29:53.542 INFO:teuthology.orchestra.run.smithi197:> hostname 2020-04-28T12:29:53.564 INFO:teuthology.orchestra.run.smithi197.stdout:smithi179 2020-04-28T12:29:53.564 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:29:53.618 INFO:teuthology.orchestra.run.smithi197:> grep smithi179 /etc/hosts 2020-04-28T12:29:53.672 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2020-04-28T12:29:53.673 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:29:53.726 INFO:teuthology.orchestra.run.smithi197:> sudo hostname smithi197 2020-04-28T12:29:53.847 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:29:53.860 INFO:teuthology.orchestra.run.smithi197:> sudo sed -i -e 's/smithi179/smithi197/g' /etc/hosts 2020-04-28T12:29:53.928 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:29:53.982 INFO:teuthology.orchestra.run.smithi197:> sudo sed -i -e 's/172.21.15.179/172.21.15.197/g' /etc/hosts 2020-04-28T12:29:54.048 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:29:54.101 INFO:teuthology.orchestra.run.smithi197:> sudo sed -i -e 's/smithi179/smithi197/g' /etc/hostname 2020-04-28T12:29:54.170 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:29:54.222 INFO:teuthology.orchestra.run.smithi197:> sudo hostname smithi197 2020-04-28T12:29:54.288 INFO:teuthology.provision.fog.smithi197:Deploy complete! 2020-04-28T12:29:54.290 DEBUG:teuthology.parallel:result is None 2020-04-28T12:30:14.485 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:30:14.731 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:15.083 INFO:teuthology.orchestra.run.smithi066:> hostname 2020-04-28T12:30:15.098 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2020-04-28T12:30:15.098 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:15.153 INFO:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2020-04-28T12:30:15.208 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2020-04-28T12:30:15.208 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:15.265 INFO:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2020-04-28T12:30:15.385 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:15.399 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2020-04-28T12:30:15.471 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:15.526 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2020-04-28T12:30:15.597 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:15.651 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2020-04-28T12:30:15.722 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:15.778 INFO:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2020-04-28T12:30:15.848 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2020-04-28T12:30:15.853 DEBUG:teuthology.parallel:result is None 2020-04-28T12:30:15.980 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com 2020-04-28T12:30:15.981 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:30:16.010 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2020-04-28T12:30:16.010 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:30:16.026 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:30:16.026 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:30:16.099 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:16.271 INFO:teuthology.orchestra.run.smithi197:> uname -m 2020-04-28T12:30:16.325 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2020-04-28T12:30:16.325 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:16.383 INFO:teuthology.orchestra.run.smithi197:> cat /etc/os-release 2020-04-28T12:30:16.437 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Linux" 2020-04-28T12:30:16.437 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8 (Core)" 2020-04-28T12:30:16.437 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos" 2020-04-28T12:30:16.438 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:30:16.438 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8" 2020-04-28T12:30:16.438 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:30:16.438 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:30:16.438 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31" 2020-04-28T12:30:16.438 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:30:16.439 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:30:16.439 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:30:16.439 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:16.439 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:30:16.439 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:30:16.439 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:30:16.440 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:30:16.440 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:16.441 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2020-04-28T12:30:16.455 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:30:16.456 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:30:16.528 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:16.708 INFO:teuthology.orchestra.run.smithi066:> uname -m 2020-04-28T12:30:16.762 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2020-04-28T12:30:16.762 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:16.816 INFO:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2020-04-28T12:30:16.870 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Linux" 2020-04-28T12:30:16.870 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8 (Core)" 2020-04-28T12:30:16.871 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2020-04-28T12:30:16.871 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:30:16.871 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8" 2020-04-28T12:30:16.871 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:30:16.871 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:30:16.871 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2020-04-28T12:30:16.872 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:30:16.872 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:30:16.872 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:30:16.872 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:16.872 INFO:teuthology.orchestra.run.smithi066.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:30:16.873 INFO:teuthology.orchestra.run.smithi066.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:30:16.873 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:30:16.873 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:30:16.873 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:16.874 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2020-04-28T12:30:16.899 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-28T12:30:16.953 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi066.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJQL1eUayMgmovgCa+XVbg4LBequhqNmYDlWXj9IoMGRCJLrB40hTZhGCvI7g50CecpGqlv4hZn3Bi8wExU/U5mww9ZBoXyURKNv0fo3r/wsNbkFX+FSWQkoyLIBZQonAZcsDf4fPUkZKPkYYrjpygy6gI+qqyBKweWmLyIPloTOT77yzVxoK4qbStLTW6+QObT/6fkBFBwrK1faqGxblPEtOjomzCJ94DO2Pe0W4dey8D7uSJsjDv5huY3r6erIrs4k7O7fzmKIMe0eN6YzVixsDPTdkvh9B08tUP5lV29iboWPsCZ3/saqWYhnw7GfLg9me8EI9DRiDLaE8JBmXLRoij7wYGhxvDqvft3Cm5wu3DbhmCz267QzZ44hN+3NZkwjPqZS6E+tEp9VahlX9xakJYRQQGHvWbYVEe50gfWv+OTStiPzMh6mq/5fSRwWaKXZh4jyKVHgv8uBaidPMfoCC+6mK9Uyc7+5J3atSRaGv9f/dSmbRFpOrPTVVWYyk= smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+T8kyN13TOWfFVuIUIYnyZcmckjN1tfhlWdIftL6OUteKX5vGofnUhlZVnHf8PR9A1cWRaelhxDmAcyH8+182TLEw9Bd43TEHzBEkwVGathgnOHcHGUPELbgjVGtYVllMEuI4Jg62VpT3T3Qbt5yadiPB2E3sIwg0UQDHP30gn6t4JsMgHPZ8NmTfDYs+Mc5LiTc6cD+3gGhNAG6ZWlswYXhlXJUDt8p06IRhtT60Ot6kwWzCn6vkLjYI8o8AS9C4pPE+fShosMSkjpdJIYQixHdWgw8d1KH1UbVyKxO5BOjbhBMyhofEx2ugLCSd0/+YqdWX3nddYQFqBqPOzGlrKen3qHfpMVViyROcHdOyuu6J6S3RyrIw6N2N85GpY6qEuSgZb1F2ppu2QNG9rjffQJkq1VBpod3cXIZNX5kt3775lwYegLXJDsyp/bs7Jip3KJM7h4ZyGJ297e7+BL8eJREhkNi8eu8ahOIY/27bvnoL1x0foqZ3BjhxN9WGrZ0= 2020-04-28T12:30:16.954 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:30:17.003 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-28T12:30:17.012 INFO:teuthology.task.internal:Saving configuration 2020-04-28T12:30:17.034 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-28T12:30:17.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-28T12:30:17.183 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:25:24.659533', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi197.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHJoNqCTdXG8dUYLHD4/6AVphdxbyLHzAWQdSGvujteyqS3d2kyFpq+NI0OjCm2nkHQ3vWDTekpP+PEnIXKAQtQ=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4989993'} 2020-04-28T12:30:17.207 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:25:24.659514', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi066.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDtYuO0uM139T19VFhQZVNHcxur+Si2bhjAcsHURGesAgW34PnrkMe9d8D/HIVhdx7r8+LozfctFLWItcEl+BI4=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4989993'} 2020-04-28T12:30:17.207 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-28T12:30:17.219 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T12:30:17.220 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T12:30:17.220 INFO:teuthology.run_tasks:Running task console_log... 2020-04-28T12:30:17.332 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:30:17.333 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-28T12:30:17.350 INFO:teuthology.task.internal:Opening connections... 2020-04-28T12:30:17.351 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi197.front.sepia.ceph.com 2020-04-28T12:30:17.353 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:30:17.434 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:30:17.435 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:30:17.510 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-28T12:30:17.521 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:17.556 INFO:teuthology.orchestra.run.smithi197:> uname -m 2020-04-28T12:30:17.611 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2020-04-28T12:30:17.612 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:17.664 INFO:teuthology.orchestra.run.smithi197:> cat /etc/os-release 2020-04-28T12:30:17.732 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Linux" 2020-04-28T12:30:17.732 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8 (Core)" 2020-04-28T12:30:17.732 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos" 2020-04-28T12:30:17.732 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:30:17.732 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8" 2020-04-28T12:30:17.732 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:30:17.733 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:30:17.733 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31" 2020-04-28T12:30:17.733 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:30:17.733 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:30:17.733 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:30:17.734 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:17.734 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:30:17.734 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:30:17.735 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:30:17.735 INFO:teuthology.orchestra.run.smithi197.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:30:17.735 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:17.735 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2020-04-28T12:30:17.753 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:17.769 INFO:teuthology.orchestra.run.smithi066:> uname -m 2020-04-28T12:30:17.823 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2020-04-28T12:30:17.823 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:17.877 INFO:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2020-04-28T12:30:17.931 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Linux" 2020-04-28T12:30:17.931 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8 (Core)" 2020-04-28T12:30:17.932 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2020-04-28T12:30:17.932 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:30:17.932 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8" 2020-04-28T12:30:17.932 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:30:17.932 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:30:17.932 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2020-04-28T12:30:17.932 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:30:17.933 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:30:17.933 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:30:17.933 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:17.933 INFO:teuthology.orchestra.run.smithi066.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:30:17.933 INFO:teuthology.orchestra.run.smithi066.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:30:17.933 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:30:17.933 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:30:17.934 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:17.934 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2020-04-28T12:30:17.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-28T12:30:17.962 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-28T12:30:18.016 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-28T12:30:18.017 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:18.031 INFO:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:30:18.074 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:18.087 INFO:teuthology.orchestra.run.smithi197:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:30:18.143 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-28T12:30:18.152 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-28T12:30:18.152 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:18.167 INFO:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:30:18.209 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:18.223 INFO:teuthology.orchestra.run.smithi197:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:30:18.299 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-28T12:30:18.383 INFO:teuthology.run_tasks:Running task kernel... 2020-04-28T12:30:18.406 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'node-exporter.b': {'sha1': 'distro', 'kdb': True}, 'node-exporter.a': {'sha1': 'distro', 'kdb': True}, 'prometheus.a': {'sha1': 'distro', 'kdb': True}} 2020-04-28T12:30:18.406 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-28T12:30:18.407 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:18.420 INFO:teuthology.orchestra.run.smithi197:> uname -r 2020-04-28T12:30:18.479 INFO:teuthology.orchestra.run.smithi197.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:18.479 INFO:teuthology.task.kernel:Running kernel on smithi197: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:18.480 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:18.532 INFO:teuthology.orchestra.run.smithi197:> sudo yum install -y kernel 2020-04-28T12:30:21.405 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS-8 - AppStream 24 MB/s | 7.0 MB 00:00 2020-04-28T12:30:22.598 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-04-28T12:30:23.025 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS-8 - Extras 88 kB/s | 5.5 kB 00:00 2020-04-28T12:30:23.170 INFO:teuthology.orchestra.run.smithi197.stdout:Copr repo for ceph-el8 owned by ktdreyer 478 kB/s | 47 kB 00:00 2020-04-28T12:30:23.497 INFO:teuthology.orchestra.run.smithi197.stdout:Extra Packages for Enterprise Linux 24 MB/s | 6.4 MB 00:00 2020-04-28T12:30:24.839 INFO:teuthology.orchestra.run.smithi197.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-04-28T12:30:25.773 INFO:teuthology.orchestra.run.smithi197.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:30:25.773 INFO:teuthology.orchestra.run.smithi197.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2020-04-28T12:30:25.917 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:30:25.937 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:30:25.937 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:30:26.050 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:26.104 INFO:teuthology.orchestra.run.smithi197:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:30:26.525 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:30:24 PM UTC. 2020-04-28T12:30:26.902 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:30:26.903 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:30:26.903 INFO:teuthology.orchestra.run.smithi197.stdout: Package Architecture Version Repository Size 2020-04-28T12:30:26.903 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:30:26.903 INFO:teuthology.orchestra.run.smithi197.stdout:Reinstalling: 2020-04-28T12:30:26.904 INFO:teuthology.orchestra.run.smithi197.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:30:26.904 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:26.904 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:30:26.904 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:30:26.904 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:26.905 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 1.5 M 2020-04-28T12:30:26.905 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 0 2020-04-28T12:30:26.905 INFO:teuthology.orchestra.run.smithi197.stderr:Operation aborted. 2020-04-28T12:30:26.978 INFO:teuthology.orchestra.run.smithi197.stdout:Is this ok [y/N]: 2020-04-28T12:30:26.978 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:26.991 INFO:teuthology.orchestra.run.smithi197:> sudo yum reinstall -y kernel || true 2020-04-28T12:30:27.416 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:30:24 PM UTC. 2020-04-28T12:30:27.760 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:30:27.761 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:30:27.761 INFO:teuthology.orchestra.run.smithi197.stdout: Package Architecture Version Repository Size 2020-04-28T12:30:27.762 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:30:27.762 INFO:teuthology.orchestra.run.smithi197.stdout:Reinstalling: 2020-04-28T12:30:27.762 INFO:teuthology.orchestra.run.smithi197.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:30:27.762 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:27.762 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:30:27.762 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:30:27.763 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:27.763 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 1.5 M 2020-04-28T12:30:27.763 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 0 2020-04-28T12:30:27.763 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:30:27.809 INFO:teuthology.orchestra.run.smithi197.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 33 MB/s | 1.5 MB 00:00 2020-04-28T12:30:27.810 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:30:27.810 INFO:teuthology.orchestra.run.smithi197.stdout:Total 32 MB/s | 1.5 MB 00:00 2020-04-28T12:30:27.822 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:30:27.985 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:30:27.985 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:30:28.041 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:30:28.041 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:30:28.136 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:30:28.320 INFO:teuthology.orchestra.run.smithi197.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:30:28.321 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:30:28.541 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:30:28.541 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:30:28.865 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:30:28.865 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:28.865 INFO:teuthology.orchestra.run.smithi197.stdout:Reinstalled: 2020-04-28T12:30:28.865 INFO:teuthology.orchestra.run.smithi197.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:28.865 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:30:28.866 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:30:28.951 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:28.966 INFO:teuthology.orchestra.run.smithi197:> rpm -q kernel --last | head -n 1 2020-04-28T12:30:29.049 INFO:teuthology.orchestra.run.smithi197.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:30:28 PM UTC 2020-04-28T12:30:29.050 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:29.050 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:30:29.050 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:29.066 INFO:teuthology.orchestra.run.smithi066:> uname -r 2020-04-28T12:30:29.128 INFO:teuthology.orchestra.run.smithi066.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:29.128 INFO:teuthology.task.kernel:Running kernel on smithi066: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:29.128 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:29.184 INFO:teuthology.orchestra.run.smithi066:> sudo yum install -y kernel 2020-04-28T12:30:31.899 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-8 - AppStream 40 MB/s | 7.0 MB 00:00 2020-04-28T12:30:33.177 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-04-28T12:30:33.625 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-8 - Extras 81 kB/s | 5.5 kB 00:00 2020-04-28T12:30:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:Copr repo for ceph-el8 owned by ktdreyer 490 kB/s | 47 kB 00:00 2020-04-28T12:30:34.131 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 21 MB/s | 6.4 MB 00:00 2020-04-28T12:30:35.558 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 4.5 MB/s | 20 kB 00:00 2020-04-28T12:30:36.503 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:30:36.504 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2020-04-28T12:30:36.659 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:30:36.660 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:30:36.660 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:30:36.780 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:36.833 INFO:teuthology.orchestra.run.smithi066:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:30:37.287 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:30:35 PM UTC. 2020-04-28T12:30:37.639 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:30:37.639 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:30:37.640 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2020-04-28T12:30:37.640 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:30:37.640 INFO:teuthology.orchestra.run.smithi066.stdout:Reinstalling: 2020-04-28T12:30:37.640 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:30:37.640 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:37.640 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:30:37.640 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:30:37.641 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:37.641 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 1.5 M 2020-04-28T12:30:37.641 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 0 2020-04-28T12:30:37.642 INFO:teuthology.orchestra.run.smithi066.stderr:Operation aborted. 2020-04-28T12:30:37.766 INFO:teuthology.orchestra.run.smithi066.stdout:Is this ok [y/N]: 2020-04-28T12:30:37.766 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:37.780 INFO:teuthology.orchestra.run.smithi066:> sudo yum reinstall -y kernel || true 2020-04-28T12:30:38.234 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:30:35 PM UTC. 2020-04-28T12:30:38.581 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:30:38.582 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:30:38.582 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2020-04-28T12:30:38.582 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:30:38.582 INFO:teuthology.orchestra.run.smithi066.stdout:Reinstalling: 2020-04-28T12:30:38.582 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:30:38.583 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:38.583 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:30:38.583 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:30:38.583 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:38.584 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 1.5 M 2020-04-28T12:30:38.584 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 0 2020-04-28T12:30:38.584 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:30:38.633 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 31 MB/s | 1.5 MB 00:00 2020-04-28T12:30:38.633 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:30:38.633 INFO:teuthology.orchestra.run.smithi066.stdout:Total 30 MB/s | 1.5 MB 00:00 2020-04-28T12:30:38.647 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:30:38.790 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:30:38.790 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:30:38.838 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:30:38.838 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:30:38.931 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:30:39.142 INFO:teuthology.orchestra.run.smithi066.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:30:39.143 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:30:39.380 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:30:39.380 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:30:39.728 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:30:39.729 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:39.729 INFO:teuthology.orchestra.run.smithi066.stdout:Reinstalled: 2020-04-28T12:30:39.729 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:39.729 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:30:39.729 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:30:39.826 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:39.839 INFO:teuthology.orchestra.run.smithi066:> rpm -q kernel --last | head -n 1 2020-04-28T12:30:39.930 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:30:38 PM UTC 2020-04-28T12:30:39.931 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:30:39.931 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:30:39.931 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-28T12:30:39.931 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:39.947 INFO:teuthology.orchestra.run.smithi197:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:30:40.024 INFO:teuthology.orchestra.run.smithi197.stdout:ttyS1 2020-04-28T12:30:40.032 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-28T12:30:40.033 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:40.047 INFO:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:30:40.127 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2020-04-28T12:30:40.139 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-28T12:30:40.150 INFO:teuthology.task.internal:Creating test directory... 2020-04-28T12:30:40.150 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:40.192 INFO:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:30:40.241 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:40.257 INFO:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:30:40.313 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-28T12:30:40.324 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-28T12:30:40.351 INFO:teuthology.task.internal:Creating archive directory... 2020-04-28T12:30:40.351 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:40.364 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:30:40.407 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:40.422 INFO:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:30:40.499 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-28T12:30:40.512 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-28T12:30:40.512 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:40.526 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:30:40.569 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:40.585 INFO:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:30:40.608 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:30:40.625 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:30:40.667 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:30:40.683 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:30:40.684 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-28T12:30:40.694 INFO:teuthology.task.internal:Configuring sudo... 2020-04-28T12:30:40.694 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:40.709 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:30:40.751 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:40.766 INFO:teuthology.orchestra.run.smithi197:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:30:40.836 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-28T12:30:40.850 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-28T12:30:40.850 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:40.864 INFO:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:30:40.907 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:40.921 INFO:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:30:40.979 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:41.033 INFO:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:30:41.104 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:41.143 INFO:teuthology.orchestra.run.smithi197:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:30:41.221 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:41.277 INFO:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:30:41.350 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:41.387 INFO:teuthology.orchestra.run.smithi197:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:30:41.454 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:41.507 INFO:teuthology.orchestra.run.smithi197:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:30:41.592 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:41.608 INFO:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:30:41.682 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:41.722 INFO:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:30:41.804 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:41.860 INFO:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:30:41.934 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:41.972 INFO:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:30:42.046 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:42.101 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:30:42.186 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:42.241 INFO:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2020-04-28T12:30:42.284 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:42.299 INFO:teuthology.orchestra.run.smithi197:> sudo service rsyslog restart 2020-04-28T12:30:42.375 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:30:42.411 INFO:teuthology.orchestra.run.smithi197.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:30:42.841 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-28T12:30:42.852 INFO:teuthology.task.internal:Starting timer... 2020-04-28T12:30:42.852 INFO:teuthology.run_tasks:Running task pcp... 2020-04-28T12:30:42.893 INFO:teuthology.run_tasks:Running task selinux... 2020-04-28T12:30:42.911 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-28T12:30:42.911 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:42.927 INFO:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2020-04-28T12:30:43.043 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: [ OK ] 2020-04-28T12:30:43.044 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:43.061 INFO:teuthology.orchestra.run.smithi197:> sudo service auditd rotate 2020-04-28T12:30:43.181 INFO:teuthology.orchestra.run.smithi197.stdout:Rotating logs: [ OK ] 2020-04-28T12:30:43.182 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-28T12:30:43.183 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:43.197 INFO:teuthology.orchestra.run.smithi197:> /usr/sbin/getenforce 2020-04-28T12:30:43.266 INFO:teuthology.orchestra.run.smithi197.stdout:Permissive 2020-04-28T12:30:43.267 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:43.280 INFO:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2020-04-28T12:30:43.359 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2020-04-28T12:30:43.359 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi197.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': u'permissive'} 2020-04-28T12:30:43.360 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:43.372 INFO:teuthology.orchestra.run.smithi197:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:30:43.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:30:43.442 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:43.456 INFO:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:30:43.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:30:43.535 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-28T12:30:43.536 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:30:43.549 INFO:teuthology.orchestra.run.smithi197:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:30:43.636 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:30:43.650 INFO:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:30:43.736 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-28T12:30:43.748 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-04-28T12:30:43.756 INFO:teuthology.repo_utils:Fetching master from origin 2020-04-28T12:30:43.805 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-28T12:30:43.821 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-28T12:30:43.824 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi197.front.sepia.ceph.com,smithi066.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-28T12:30:44.191 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-28T12:30:45.313 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-28T12:30:48.281 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-28T12:30:48.304 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:48 +0000 (0:00:00.066) 0:00:00.066 ********* 2020-04-28T12:30:48.319 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:48 +0000 (0:00:00.012) 0:00:00.078 ********* 2020-04-28T12:30:49.820 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi066.front.sepia.ceph.com] 2020-04-28T12:30:49.865 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] 2020-04-28T12:30:49.906 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:49 +0000 (0:00:01.589) 0:00:01.668 ********* 2020-04-28T12:30:49.972 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:49 +0000 (0:00:00.066) 0:00:01.734 ********* 2020-04-28T12:30:50.259 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-28T12:30:50.260 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:30:50.300 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:50 +0000 (0:00:00.328) 0:00:02.063 ********* 2020-04-28T12:30:50.308 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:30:50.369 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:50 +0000 (0:00:00.068) 0:00:02.131 ********* 2020-04-28T12:30:50.886 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-28T12:30:50.888 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:30:50.925 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:50 +0000 (0:00:00.556) 0:00:02.687 ********* 2020-04-28T12:30:50.935 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:30:50.978 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:50 +0000 (0:00:00.052) 0:00:02.740 ********* 2020-04-28T12:30:50.986 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:51.023 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:51 +0000 (0:00:00.045) 0:00:02.785 ********* 2020-04-28T12:30:51.028 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:51.068 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:51 +0000 (0:00:00.045) 0:00:02.831 ********* 2020-04-28T12:30:51.354 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-28T12:30:51.357 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:30:51.393 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:51 +0000 (0:00:00.324) 0:00:03.155 ********* 2020-04-28T12:30:51.401 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:30:51.441 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:51 +0000 (0:00:00.048) 0:00:03.204 ********* 2020-04-28T12:30:52.296 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-04-28T12:30:52.297 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "state": "file", "uid": 0} 2020-04-28T12:30:52.343 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:52 +0000 (0:00:00.901) 0:00:04.105 ********* 2020-04-28T12:30:52.348 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "state": "file", "uid": 0} 2020-04-28T12:30:52.387 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:52 +0000 (0:00:00.043) 0:00:04.149 ********* 2020-04-28T12:30:53.038 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-28T12:30:53.038 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-28T12:30:53.040 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-28T12:30:53.078 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-28T12:30:53.080 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-28T12:30:53.195 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-28T12:30:53.206 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-28T12:30:53.396 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:53 +0000 (0:00:01.008) 0:00:05.158 ********* 2020-04-28T12:30:53.433 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:53 +0000 (0:00:00.037) 0:00:05.195 ********* 2020-04-28T12:30:54.081 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-28T12:30:54.083 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] 2020-04-28T12:30:54.129 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] 2020-04-28T12:30:54.182 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-04-28T12:30:54.183 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:54 +0000 (0:00:00.749) 0:00:05.944 ********* 2020-04-28T12:30:54.254 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:54 +0000 (0:00:00.071) 0:00:06.016 ********* 2020-04-28T12:30:54.749 INFO:teuthology.task.ansible.out: 2020-04-28T12:30:54.751 INFO:teuthology.task.ansible.out:TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-28T12:30:54.751 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.146120", "end": "2020-04-28 12:30:54.728761", "rc": 0, "start": "2020-04-28 12:30:54.582641", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:30:54.793 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:54 +0000 (0:00:00.538) 0:00:06.555 ********* 2020-04-28T12:30:54.800 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.172900", "end": "2020-04-28 12:30:54.753037", "rc": 0, "start": "2020-04-28 12:30:54.580137", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:30:54.852 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:54 +0000 (0:00:00.058) 0:00:06.614 ********* 2020-04-28T12:30:55.027 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015377", "end": "2020-04-28 12:30:54.995030", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:30:54.979653", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:30:55.062 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.210) 0:00:06.825 ********* 2020-04-28T12:30:55.079 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.020008", "end": "2020-04-28 12:30:55.051541", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:30:55.031533", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:30:55.118 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.055) 0:00:06.880 ********* 2020-04-28T12:30:55.123 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-28T12:30:55.124 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:30:55.163 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.045) 0:00:06.926 ********* 2020-04-28T12:30:55.170 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:30:55.210 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.047) 0:00:06.973 ********* 2020-04-28T12:30:55.216 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-28T12:30:55.216 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.262 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.049) 0:00:07.022 ********* 2020-04-28T12:30:55.271 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.305 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.045) 0:00:07.067 ********* 2020-04-28T12:30:55.310 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-28T12:30:55.312 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.351 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.045) 0:00:07.113 ********* 2020-04-28T12:30:55.359 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.397 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.045) 0:00:07.159 ********* 2020-04-28T12:30:55.404 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.443 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.046) 0:00:07.205 ********* 2020-04-28T12:30:55.449 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.492 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.048) 0:00:07.254 ********* 2020-04-28T12:30:55.498 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-28T12:30:55.498 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.539 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.047) 0:00:07.301 ********* 2020-04-28T12:30:55.545 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.583 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.043) 0:00:07.345 ********* 2020-04-28T12:30:55.594 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-28T12:30:55.596 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.631 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.048) 0:00:07.394 ********* 2020-04-28T12:30:55.637 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.676 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:55 +0000 (0:00:00.044) 0:00:07.438 ********* 2020-04-28T12:30:55.693 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-04-28T12:30:55.693 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.695 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.709 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b 2020-04-28T12:30:55.710 INFO:teuthology.task.ansible.out:87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.719 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.720 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.721 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.732 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.733 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.735 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.736 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.737 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.750 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.750 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.752 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.790 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOt 2020-04-28T12:30:55.792 INFO:teuthology.task.ansible.out:sItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc09659 2020-04-28T12:30:55.793 INFO:teuthology.task.ansible.out:4ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.798 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.799 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.799 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.801 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYu 2020-04-28T12:30:55.802 INFO:teuthology.task.ansible.out:RIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.811 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.823 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.834 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.845 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.847 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.848 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.849 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.851 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.851 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.852 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngr 2020-04-28T12:30:55.854 INFO:teuthology.task.ansible.out:egf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI8 2020-04-28T12:30:55.855 INFO:teuthology.task.ansible.out:3pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.894 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a98 2020-04-28T12:30:55.896 INFO:teuthology.task.ansible.out:2e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.901 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.902 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.904 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.919 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX 2020-04-28T12:30:55.920 INFO:teuthology.task.ansible.out:8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.921 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.922 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.925 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.926 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.931 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.932 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.934 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.934 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.935 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.937 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.938 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.938 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.940 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.941 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.962 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.963 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.964 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.964 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.967 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.967 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.969 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.970 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.972 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.973 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.973 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.984 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.985 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.986 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.997 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.997 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:55.999 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.009 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.011 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.012 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.014 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.025 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.026 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.027 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.038 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.039 INFO:teuthology.task.ansible.out: skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.050 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.051 INFO:teuthology.task.ansible.out: skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.052 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.054 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.066 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.066 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.068 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.078 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.079 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.080 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.081 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.092 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.093 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.094 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.094 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.096 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.107 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.108 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.110 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.120 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.121 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.122 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.136 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanja 2020-04-28T12:30:56.138 INFO:teuthology.task.ansible.out:ra@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.148 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.148 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.150 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.169 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.174 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.175 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.176 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.177 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.191 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.200 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.201 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.212 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.212 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.225 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.226 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.237 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.327 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.339 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.351 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.362 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.363 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.374 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.386 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.388 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.410 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.421 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.422 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.423 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.434 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.435 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.436 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.436 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.438 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.448 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.449 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.451 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.460 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.461 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.461 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.472 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.473 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.484 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.485 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.487 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.488 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.509 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.510 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.512 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.512 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.513 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.515 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.526 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.527 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.539 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.569 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.570 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.572 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.572 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.573 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.616 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.940) 0:00:08.379 ********* 2020-04-28T12:30:56.648 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {" 2020-04-28T12:30:56.650 INFO:teuthology.task.ansible.out:name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.657 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:30:56.704 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.086) 0:00:08.465 ********* 2020-04-28T12:30:56.748 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.044) 0:00:08.510 ********* 2020-04-28T12:30:56.753 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-28T12:30:56.756 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.797 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.049) 0:00:08.559 ********* 2020-04-28T12:30:56.803 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:30:56.842 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.044) 0:00:08.604 ********* 2020-04-28T12:30:56.847 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-28T12:30:56.847 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.886 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.044) 0:00:08.648 ********* 2020-04-28T12:30:56.893 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-28T12:30:56.894 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.937 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.051) 0:00:08.700 ********* 2020-04-28T12:30:56.948 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:56.982 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:56 +0000 (0:00:00.044) 0:00:08.745 ********* 2020-04-28T12:30:56.988 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-28T12:30:56.990 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.036 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.053) 0:00:08.798 ********* 2020-04-28T12:30:57.045 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.080 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.043) 0:00:08.842 ********* 2020-04-28T12:30:57.087 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.127 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.047) 0:00:08.889 ********* 2020-04-28T12:30:57.132 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-28T12:30:57.134 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.170 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.043) 0:00:08.933 ********* 2020-04-28T12:30:57.176 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-28T12:30:57.177 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.235 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.064) 0:00:08.997 ********* 2020-04-28T12:30:57.241 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:30:57.241 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.242 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.243 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.244 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.244 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.245 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.257 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.258 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.259 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.270 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.270 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.272 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.273 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.324 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.088) 0:00:09.086 ********* 2020-04-28T12:30:57.330 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.330 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.332 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.333 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.334 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.336 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.336 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.337 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.349 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.350 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.350 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.364 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.364 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.366 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.378 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.378 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.380 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.380 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.399 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.405 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.405 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.427 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.427 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.431 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.439 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.440 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.441 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.443 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.443 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.444 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.448 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.494 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.170) 0:00:09.256 ********* 2020-04-28T12:30:57.501 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.503 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.504 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.505 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.506 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.507 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.508 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.521 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.544 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.544 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.546 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.556 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.568 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.594 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.596 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.606 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.607 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.618 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.619 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.629 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.646 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:30:57.685 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:57 +0000 (0:00:00.191) 0:00:09.447 ********* 2020-04-28T12:30:57.999 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-28T12:30:58.050 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.361) 0:00:09.809 ********* 2020-04-28T12:30:58.077 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-28T12:30:58.078 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => { "msg": "Host smithi066.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:30:58.116 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.068) 0:00:09.878 ********* 2020-04-28T12:30:58.166 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-28T12:30:58.168 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:30:58.219 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.103) 0:00:09.981 ********* 2020-04-28T12:30:58.226 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-28T12:30:58.227 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-28T12:30:58.268 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.048) 0:00:10.030 ********* 2020-04-28T12:30:58.273 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-28T12:30:58.275 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:58.319 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.051) 0:00:10.081 ********* 2020-04-28T12:30:58.333 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi197.front.sepia.ceph.com] => { "msg": "Host smithi197.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:30:58.365 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.045) 0:00:10.127 ********* 2020-04-28T12:30:58.405 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-28T12:30:58.407 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:30:58.445 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.079) 0:00:10.207 ********* 2020-04-28T12:30:58.471 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-28T12:30:58.473 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:58.509 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.064) 0:00:10.271 ********* 2020-04-28T12:30:58.611 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-28T12:30:58.612 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.083683", "end": "2020-04-28 12:30:58.587595", "rc": 0, "start": "2020-04-28 12:30:58.503912", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:30:58.657 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.147) 0:00:10.419 ********* 2020-04-28T12:30:58.707 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-28T12:30:58.709 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:58.748 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.090) 0:00:10.510 ********* 2020-04-28T12:30:58.786 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-28T12:30:58.788 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:58.828 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.080) 0:00:10.591 ********* 2020-04-28T12:30:58.834 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-28T12:30:58.835 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.103508", "end": "2020-04-28 12:30:58.786804", "rc": 0, "start": "2020-04-28 12:30:58.683296", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:30:58.876 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.047) 0:00:10.639 ********* 2020-04-28T12:30:58.882 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-28T12:30:58.883 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:58.922 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.045) 0:00:10.684 ********* 2020-04-28T12:30:58.928 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-04-28T12:30:58.929 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:58.969 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:58 +0000 (0:00:00.047) 0:00:10.731 ********* 2020-04-28T12:30:58.974 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-28T12:30:58.976 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.017 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.047) 0:00:10.779 ********* 2020-04-28T12:30:59.025 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-28T12:30:59.026 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.063 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.046) 0:00:10.826 ********* 2020-04-28T12:30:59.071 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.108 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.044) 0:00:10.870 ********* 2020-04-28T12:30:59.114 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-28T12:30:59.115 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.157 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.049) 0:00:10.919 ********* 2020-04-28T12:30:59.162 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-28T12:30:59.164 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.202 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.045) 0:00:10.965 ********* 2020-04-28T12:30:59.208 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-28T12:30:59.210 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.250 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.047) 0:00:11.012 ********* 2020-04-28T12:30:59.258 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi066.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:30:59.295 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.044) 0:00:11.057 ********* 2020-04-28T12:30:59.301 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-28T12:30:59.302 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.339 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.044) 0:00:11.102 ********* 2020-04-28T12:30:59.346 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-28T12:30:59.348 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.385 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.045) 0:00:11.147 ********* 2020-04-28T12:30:59.391 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-28T12:30:59.393 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.430 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.045) 0:00:11.193 ********* 2020-04-28T12:30:59.436 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-28T12:30:59.436 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.481 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.050) 0:00:11.243 ********* 2020-04-28T12:30:59.486 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-28T12:30:59.487 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:30:59.488 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:30:59.531 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.050) 0:00:11.294 ********* 2020-04-28T12:30:59.537 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-28T12:30:59.542 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:30:59.585 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.052) 0:00:11.346 ********* 2020-04-28T12:30:59.592 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-04-28T12:30:59.594 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.631 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.046) 0:00:11.393 ********* 2020-04-28T12:30:59.637 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-04-28T12:30:59.637 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.677 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.045) 0:00:11.439 ********* 2020-04-28T12:30:59.682 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-28T12:30:59.684 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.727 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.050) 0:00:11.489 ********* 2020-04-28T12:30:59.732 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-28T12:30:59.733 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:30:59.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.048) 0:00:11.538 ********* 2020-04-28T12:30:59.783 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-28T12:30:59.784 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:30:59.821 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.044) 0:00:11.583 ********* 2020-04-28T12:30:59.826 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-28T12:30:59.834 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.877 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.050) 0:00:11.634 ********* 2020-04-28T12:30:59.878 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:30:59.917 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:30:59 +0000 (0:00:00.045) 0:00:11.680 ********* 2020-04-28T12:30:59.922 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-28T12:30:59.923 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.080 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.162) 0:00:11.842 ********* 2020-04-28T12:31:00.086 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-28T12:31:00.087 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:31:00.127 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.047) 0:00:11.889 ********* 2020-04-28T12:31:00.132 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-28T12:31:00.134 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.183 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.056) 0:00:11.945 ********* 2020-04-28T12:31:00.189 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-28T12:31:00.191 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.240 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.056) 0:00:12.002 ********* 2020-04-28T12:31:00.245 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-28T12:31:00.246 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.286 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.046) 0:00:12.048 ********* 2020-04-28T12:31:00.292 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-28T12:31:00.293 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.331 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.044) 0:00:12.093 ********* 2020-04-28T12:31:00.336 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-28T12:31:00.337 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:31:00.379 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.047) 0:00:12.140 ********* 2020-04-28T12:31:00.384 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-28T12:31:00.386 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.426 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.048) 0:00:12.189 ********* 2020-04-28T12:31:00.434 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.471 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.044) 0:00:12.233 ********* 2020-04-28T12:31:00.478 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-28T12:31:00.481 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.519 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.048) 0:00:12.281 ********* 2020-04-28T12:31:00.524 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-28T12:31:00.526 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.568 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.049) 0:00:12.330 ********* 2020-04-28T12:31:00.574 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-04-28T12:31:00.575 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:31:00.614 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.045) 0:00:12.376 ********* 2020-04-28T12:31:00.619 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-28T12:31:00.619 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.657 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.043) 0:00:12.419 ********* 2020-04-28T12:31:00.663 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:31:00.663 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.707 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.049) 0:00:12.469 ********* 2020-04-28T12:31:00.714 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-28T12:31:00.715 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.754 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.047) 0:00:12.517 ********* 2020-04-28T12:31:00.764 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.801 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.046) 0:00:12.563 ********* 2020-04-28T12:31:00.807 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.846 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.045) 0:00:12.608 ********* 2020-04-28T12:31:00.852 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-28T12:31:00.854 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.890 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.044) 0:00:12.653 ********* 2020-04-28T12:31:00.897 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.937 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.046) 0:00:12.699 ********* 2020-04-28T12:31:00.944 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-28T12:31:00.946 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:00.982 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:00 +0000 (0:00:00.044) 0:00:12.744 ********* 2020-04-28T12:31:00.987 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-28T12:31:00.988 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:31:01.026 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.044) 0:00:12.788 ********* 2020-04-28T12:31:01.032 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-28T12:31:01.033 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:01.070 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.044) 0:00:12.833 ********* 2020-04-28T12:31:01.076 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-28T12:31:01.115 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.044) 0:00:12.878 ********* 2020-04-28T12:31:01.121 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-28T12:31:01.122 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:01.167 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.051) 0:00:12.929 ********* 2020-04-28T12:31:01.172 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-28T12:31:01.173 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:01.214 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.047) 0:00:12.976 ********* 2020-04-28T12:31:01.220 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-28T12:31:01.221 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:31:01.258 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.043) 0:00:13.020 ********* 2020-04-28T12:31:01.283 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-28T12:31:01.322 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.064) 0:00:13.084 ********* 2020-04-28T12:31:01.359 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:01.396 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.073) 0:00:13.158 ********* 2020-04-28T12:31:01.443 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-28T12:31:01.445 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:31:01.480 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.084) 0:00:13.243 ********* 2020-04-28T12:31:01.626 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:31:01.663 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:01 +0000 (0:00:00.183) 0:00:13.426 ********* 2020-04-28T12:31:02.008 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-04-28T12:31:02.009 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:31:02.168 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:31:02.506 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:31:02.546 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:02 +0000 (0:00:00.882) 0:00:14.308 ********* 2020-04-28T12:31:02.639 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:31:02.700 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:02 +0000 (0:00:00.154) 0:00:14.462 ********* 2020-04-28T12:31:03.066 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-28T12:31:03.067 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:31:03.201 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:31:03.577 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:31:03.621 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.921) 0:00:15.383 ********* 2020-04-28T12:31:03.658 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:31:03.660 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi197.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:31:03.699 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.077) 0:00:15.461 ********* 2020-04-28T12:31:03.733 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.034) 0:00:15.495 ********* 2020-04-28T12:31:03.737 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:31:03.738 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:03.779 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.045) 0:00:15.541 ********* 2020-04-28T12:31:03.785 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:31:03.786 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:03.831 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.051) 0:00:15.593 ********* 2020-04-28T12:31:03.836 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-28T12:31:03.846 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:03.876 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.045) 0:00:15.639 ********* 2020-04-28T12:31:03.881 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:31:03.882 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:03.919 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.042) 0:00:15.681 ********* 2020-04-28T12:31:03.924 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-28T12:31:03.927 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:03.964 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:03 +0000 (0:00:00.045) 0:00:15.726 ********* 2020-04-28T12:31:03.971 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.008 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.044) 0:00:15.771 ********* 2020-04-28T12:31:04.013 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:31:04.015 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.052 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.043) 0:00:15.814 ********* 2020-04-28T12:31:04.057 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-28T12:31:04.059 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.115 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.063) 0:00:15.877 ********* 2020-04-28T12:31:04.122 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-28T12:31:04.123 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.164 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.048) 0:00:15.925 ********* 2020-04-28T12:31:04.172 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.211 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.047) 0:00:15.973 ********* 2020-04-28T12:31:04.216 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-28T12:31:04.218 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.260 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.048) 0:00:16.022 ********* 2020-04-28T12:31:04.271 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.309 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.049) 0:00:16.071 ********* 2020-04-28T12:31:04.314 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-28T12:31:04.314 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.354 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.044) 0:00:16.116 ********* 2020-04-28T12:31:04.359 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-28T12:31:04.359 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.401 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.045) 0:00:16.161 ********* 2020-04-28T12:31:04.405 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-28T12:31:04.407 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.445 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.045) 0:00:16.207 ********* 2020-04-28T12:31:04.451 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-28T12:31:04.452 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.493 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.047) 0:00:16.255 ********* 2020-04-28T12:31:04.518 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-28T12:31:04.520 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:04.557 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:04 +0000 (0:00:00.064) 0:00:16.319 ********* 2020-04-28T12:31:05.526 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.772001", "end": "2020-04-28 12:31:05.500320", "rc": 0, "start": "2020-04-28 12:31:04.728319", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:31:05.527 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.867547", "end": "2020-04-28 12:31:05.501042", "rc": 0, "start": "2020-04-28 12:31:04.633495", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:31:05.563 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:05 +0000 (0:00:01.006) 0:00:17.326 ********* 2020-04-28T12:31:05.597 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:05 +0000 (0:00:00.033) 0:00:17.359 ********* 2020-04-28T12:31:06.675 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:31:06.696 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:06 +0000 (0:00:01.099) 0:00:18.458 ********* 2020-04-28T12:31:06.722 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-28T12:31:06.724 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:31:06.762 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:06 +0000 (0:00:00.066) 0:00:18.524 ********* 2020-04-28T12:31:06.801 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:06 +0000 (0:00:00.039) 0:00:18.563 ********* 2020-04-28T12:31:06.806 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-28T12:31:06.808 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:06.856 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:06 +0000 (0:00:00.054) 0:00:18.618 ********* 2020-04-28T12:31:06.861 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-28T12:31:06.863 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:06.900 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:06 +0000 (0:00:00.045) 0:00:18.663 ********* 2020-04-28T12:31:06.906 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:06.945 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:06 +0000 (0:00:00.044) 0:00:18.707 ********* 2020-04-28T12:31:06.951 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-28T12:31:06.951 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:06.990 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:06 +0000 (0:00:00.044) 0:00:18.752 ********* 2020-04-28T12:31:06.996 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:07.035 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:07 +0000 (0:00:00.044) 0:00:18.797 ********* 2020-04-28T12:31:07.043 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-28T12:31:07.045 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:07.081 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:07 +0000 (0:00:00.046) 0:00:18.844 ********* 2020-04-28T12:31:07.087 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:07.127 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:07 +0000 (0:00:00.045) 0:00:18.889 ********* 2020-04-28T12:31:07.552 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-28T12:31:07.553 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:31:07.602 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:07 +0000 (0:00:00.475) 0:00:19.364 ********* 2020-04-28T12:31:07.652 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:31:07.695 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:07 +0000 (0:00:00.089) 0:00:19.454 ********* 2020-04-28T12:31:08.521 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-04-28T12:31:08.522 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:31:08.567 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:08 +0000 (0:00:00.874) 0:00:20.329 ********* 2020-04-28T12:31:08.668 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:31:08.708 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:08 +0000 (0:00:00.141) 0:00:20.470 ********* 2020-04-28T12:31:09.072 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-28T12:31:09.072 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:31:09.230 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:31:09.575 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:31:09.729 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:31:10.036 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:31:10.083 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:10 +0000 (0:00:01.374) 0:00:21.845 ********* 2020-04-28T12:31:10.225 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:31:10.266 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:10 +0000 (0:00:00.183) 0:00:22.028 ********* 2020-04-28T12:31:10.283 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-28T12:31:10.283 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:31:10.322 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:10 +0000 (0:00:00.056) 0:00:22.085 ********* 2020-04-28T12:31:10.482 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:31:10.522 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:10 +0000 (0:00:00.199) 0:00:22.284 ********* 2020-04-28T12:31:10.801 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-28T12:31:10.802 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:31:11.021 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:31:11.245 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:31:11.495 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:31:11.716 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:31:11.760 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:11 +0000 (0:00:01.238) 0:00:23.522 ********* 2020-04-28T12:31:11.786 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-28T12:31:11.788 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:11.834 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:11 +0000 (0:00:00.066) 0:00:23.589 ********* 2020-04-28T12:31:11.865 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-28T12:31:11.867 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:31:11.910 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:11 +0000 (0:00:00.083) 0:00:23.672 ********* 2020-04-28T12:31:12.016 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-28T12:31:12.017 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:31:12.058 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:12 +0000 (0:00:00.148) 0:00:23.820 ********* 2020-04-28T12:31:12.086 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-28T12:31:12.087 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.129 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:12 +0000 (0:00:00.071) 0:00:23.891 ********* 2020-04-28T12:31:12.136 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:31:12.187 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:12 +0000 (0:00:00.051) 0:00:23.942 ********* 2020-04-28T12:31:12.188 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:31:12.229 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:12 +0000 (0:00:00.049) 0:00:23.992 ********* 2020-04-28T12:31:12.236 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-28T12:31:12.237 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.248 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.260 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.304 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:12 +0000 (0:00:00.074) 0:00:24.067 ********* 2020-04-28T12:31:12.446 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:31:12.485 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:12 +0000 (0:00:00.180) 0:00:24.247 ********* 2020-04-28T12:31:12.546 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-28T12:31:12.548 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.574 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.595 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.606 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:12.645 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:12 +0000 (0:00:00.160) 0:00:24.407 ********* 2020-04-28T12:31:13.229 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-28T12:31:13.229 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:31:13.274 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:13 +0000 (0:00:00.628) 0:00:25.036 ********* 2020-04-28T12:31:13.311 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:13.353 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:13 +0000 (0:00:00.078) 0:00:25.114 ********* 2020-04-28T12:31:13.646 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:31:13.705 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:13 +0000 (0:00:00.351) 0:00:25.466 ********* 2020-04-28T12:31:13.744 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:13.783 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:13 +0000 (0:00:00.079) 0:00:25.545 ********* 2020-04-28T12:31:13.852 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-28T12:31:13.853 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:31:13.911 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:13 +0000 (0:00:00.127) 0:00:25.673 ********* 2020-04-28T12:31:14.296 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:31:14.336 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:14 +0000 (0:00:00.424) 0:00:26.098 ********* 2020-04-28T12:31:14.399 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:31:14.399 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:31:14.444 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:14 +0000 (0:00:00.106) 0:00:26.204 ********* 2020-04-28T12:31:14.482 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi197.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:14.485 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:14.539 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:14 +0000 (0:00:00.097) 0:00:26.302 ********* 2020-04-28T12:31:14.763 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-28T12:31:14.764 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:31:14.805 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:14 +0000 (0:00:00.265) 0:00:26.567 ********* 2020-04-28T12:31:14.841 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:31:14.842 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:31:14.882 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:14 +0000 (0:00:00.076) 0:00:26.644 ********* 2020-04-28T12:31:14.919 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi066.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:14.920 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:31:14.964 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:14 +0000 (0:00:00.082) 0:00:26.726 ********* 2020-04-28T12:31:15.045 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi197.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-28T12:31:15.084 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:15 +0000 (0:00:00.120) 0:00:26.847 ********* 2020-04-28T12:31:15.112 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-28T12:31:15.113 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:15.151 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:15 +0000 (0:00:00.066) 0:00:26.913 ********* 2020-04-28T12:31:15.189 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-28T12:31:15.190 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:31:15.228 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:15 +0000 (0:00:00.076) 0:00:26.990 ********* 2020-04-28T12:31:15.480 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-28T12:31:15.482 INFO:teuthology.task.ansible.out:fatal: [smithi066.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-28T12:31:15.524 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:15 +0000 (0:00:00.296) 0:00:27.287 ********* 2020-04-28T12:31:15.557 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:15.597 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:15 +0000 (0:00:00.072) 0:00:27.359 ********* 2020-04-28T12:31:15.640 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-28T12:31:15.640 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:31:15.689 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:15 +0000 (0:00:00.091) 0:00:27.451 ********* 2020-04-28T12:31:16.122 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:31:16.159 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:16 +0000 (0:00:00.470) 0:00:27.922 ********* 2020-04-28T12:31:16.484 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-28T12:31:16.485 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:29:46 UTC", "ActiveEnterTimestampMonotonic": "14309494", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target systemd-tmpfiles-setup.service tmp.mount systemd-journald.socket system.slice basic.target sysinit.target time-sync.target var-run.mount -.mount nss-lookup.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:29:46 UTC", "AssertTimestampMonotonic": "14308534", "Before": "plymouth-quit.service multi-user.target xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:29:46 UTC", "ConditionTimestampMonotonic": "14308533", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-28T12:31:16.487 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2504", "ExecMainStartTimestamp": "Tue 2020-04-28 12:29:46 UTC", "ExecMainStartTimestampMonotonic": "14309454", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:29:46 UTC] ; stop_time=[n/a] ; pid=2504 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "985", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:29:46 UTC", "InactiveExitTimestampMonotonic": "14309494", "InvocationID": "f794ecb7c82f4b11afe897b8ac0942e9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-28T12:31:16.488 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2504", "MemoryAccounting": "yes", "MemoryCurrent": "1155072", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-28T12:31:16.490 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:29:46 UTC", "StateChangeTimestampMonotonic": "14309494", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "989", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:29:46 UTC", "WatchdogTimestampMonotonic": "14309493", "WatchdogUSec": "0"}} 2020-04-28T12:31:16.522 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:16 +0000 (0:00:00.362) 0:00:28.285 ********* 2020-04-28T12:31:16.531 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:29:38 UTC", "ActiveEnterTimestampMonotonic": "13874645", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service time-sync.target network.target local-fs.target nss-lookup.target system.slice -.mount tmp.mount sysinit.target systemd-journald.socket basic.target var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:29:38 UTC", "AssertTimestampMonotonic": "13873496", "Before": "shutdown.target getty@tty1.service plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:29:38 UTC", "ConditionTimestampMonotonic": "13873496", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-28T12:31:16.533 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2488", "ExecMainStartTimestamp": "Tue 2020-04-28 12:29:38 UTC", "ExecMainStartTimestampMonotonic": "13874618", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:29:38 UTC] ; stop_time=[n/a] ; pid=2488 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "985", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:29:38 UTC", "InactiveExitTimestampMonotonic": "13874645", "InvocationID": "4dab1e4076a540508518c178fa67bf51", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-28T12:31:16.534 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2488", "MemoryAccounting": "yes", "MemoryCurrent": "1171456", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-28T12:31:16.535 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:29:38 UTC", "StateChangeTimestampMonotonic": "13874645", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "989", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:29:38 UTC", "WatchdogTimestampMonotonic": "13874644", "WatchdogUSec": "0"}} 2020-04-28T12:31:16.572 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:16 +0000 (0:00:00.050) 0:00:28.335 ********* 2020-04-28T12:31:16.714 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001726", "end": "2020-04-28 12:31:16.692149", "rc": 0, "start": "2020-04-28 12:31:16.690423", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:31:16.755 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:16 +0000 (0:00:00.182) 0:00:28.517 ********* 2020-04-28T12:31:16.794 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001736", "end": "2020-04-28 12:31:16.766967", "rc": 0, "start": "2020-04-28 12:31:16.765231", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:31:16.837 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:16 +0000 (0:00:00.082) 0:00:28.600 ********* 2020-04-28T12:31:17.692 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-28T12:31:17.694 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:31:17.730 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:17 +0000 (0:00:00.892) 0:00:29.493 ********* 2020-04-28T12:31:17.805 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:31:17.852 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:17 +0000 (0:00:00.121) 0:00:29.614 ********* 2020-04-28T12:31:18.654 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-28T12:31:18.656 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:31:18.694 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:18 +0000 (0:00:00.842) 0:00:30.456 ********* 2020-04-28T12:31:18.809 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:31:18.862 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:18 +0000 (0:00:00.168) 0:00:30.625 ********* 2020-04-28T12:31:19.980 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:31:20.017 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:20 +0000 (0:00:01.154) 0:00:31.779 ********* 2020-04-28T12:31:20.034 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:31:20.075 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:20 +0000 (0:00:00.057) 0:00:31.837 ********* 2020-04-28T12:31:36.480 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-28T12:31:36.483 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.206691", "end": "2020-04-28 12:31:36.457093", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:31:20.250402", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:31:36.524 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:36 +0000 (0:00:16.444) 0:00:48.282 ********* 2020-04-28T12:31:37.004 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-28T12:31:37.005 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:31:37.048 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:37 +0000 (0:00:00.528) 0:00:48.810 ********* 2020-04-28T12:31:37.068 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-28T12:31:37.070 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.826069", "end": "2020-04-28 12:31:37.029126", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:31:20.203057", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:31:37.110 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:37 +0000 (0:00:00.062) 0:00:48.872 ********* 2020-04-28T12:31:37.257 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-28T12:31:37.258 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016854", "end": "2020-04-28 12:31:37.233071", "rc": 0, "start": "2020-04-28 12:31:37.216217", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2020-04-28T12:31:37.301 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:37 +0000 (0:00:00.190) 0:00:49.063 ********* 2020-04-28T12:31:37.505 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-28T12:31:37.506 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001992", "end": "2020-04-28 12:31:37.481180", "rc": 0, "start": "2020-04-28 12:31:37.479188", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:31:37.550 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:37 +0000 (0:00:00.249) 0:00:49.312 ********* 2020-04-28T12:31:37.624 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-28T12:31:37.625 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:31:37.686 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:37 +0000 (0:00:00.136) 0:00:49.448 ********* 2020-04-28T12:31:37.900 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-28T12:31:37.900 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.008019", "end": "2020-04-28 12:31:37.874808", "rc": 0, "start": "2020-04-28 12:31:37.866789", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2020-04-28T12:31:37.951 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:37 +0000 (0:00:00.265) 0:00:49.714 ********* 2020-04-28T12:31:38.161 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-28T12:31:38.161 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.006405", "end": "2020-04-28 12:31:38.139856", "rc": 0, "start": "2020-04-28 12:31:38.133451", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:31:38.206 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:38 +0000 (0:00:00.254) 0:00:49.968 ********* 2020-04-28T12:31:53.884 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-28T12:31:53.886 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.132198", "end": "2020-04-28 12:31:53.852444", "rc": 0, "start": "2020-04-28 12:31:37.720246", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:31:53.923 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:53 +0000 (0:00:15.716) 0:01:05.685 ********* 2020-04-28T12:31:54.122 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:31:54.158 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.235) 0:01:05.921 ********* 2020-04-28T12:31:54.194 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-28T12:31:54.195 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:31:54.235 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.076) 0:01:05.997 ********* 2020-04-28T12:31:54.272 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:31:54.277 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:31:54.313 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.077) 0:01:06.075 ********* 2020-04-28T12:31:54.350 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:31:54.351 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:31:54.390 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.077) 0:01:06.152 ********* 2020-04-28T12:31:54.427 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-28T12:31:54.428 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:31:54.466 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.076) 0:01:06.229 ********* 2020-04-28T12:31:54.660 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-28T12:31:54.661 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:31:54.697 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.230) 0:01:06.459 ********* 2020-04-28T12:31:54.890 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-28T12:31:54.891 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:31:54.929 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.231) 0:01:06.691 ********* 2020-04-28T12:31:54.956 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:31:54.957 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:55.000 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:54 +0000 (0:00:00.070) 0:01:06.762 ********* 2020-04-28T12:31:55.027 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-28T12:31:55.028 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:55.065 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.064) 0:01:06.827 ********* 2020-04-28T12:31:55.289 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi197.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:31:55.324 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.259) 0:01:07.087 ********* 2020-04-28T12:31:55.330 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-28T12:31:55.331 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.899054", "end": "2020-04-28 12:31:55.287008", "rc": 0, "start": "2020-04-28 12:31:38.387954", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:31:55.370 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.045) 0:01:07.132 ********* 2020-04-28T12:31:55.589 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-28T12:31:55.590 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:31:55.627 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.257) 0:01:07.390 ********* 2020-04-28T12:31:55.654 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-28T12:31:55.655 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:31:55.693 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.065) 0:01:07.456 ********* 2020-04-28T12:31:55.741 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:31:55.742 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:31:55.780 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.086) 0:01:07.542 ********* 2020-04-28T12:31:55.828 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:31:55.829 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:31:55.830 INFO:teuthology.task.ansible.out: 2020-04-28T12:31:55.877 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.094) 0:01:07.637 ********* 2020-04-28T12:31:55.882 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-28T12:31:55.892 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:31:55.934 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.058) 0:01:07.696 ********* 2020-04-28T12:31:55.940 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-28T12:31:55.941 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:31:55.984 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:55 +0000 (0:00:00.050) 0:01:07.746 ********* 2020-04-28T12:31:55.990 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-28T12:31:55.990 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi197"}, "changed": false} 2020-04-28T12:31:56.029 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:56 +0000 (0:00:00.044) 0:01:07.791 ********* 2020-04-28T12:31:56.185 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-28T12:31:56.186 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:31:56.223 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:56 +0000 (0:00:00.194) 0:01:07.985 ********* 2020-04-28T12:31:56.430 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-28T12:31:56.431 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:31:56.468 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:56 +0000 (0:00:00.245) 0:01:08.231 ********* 2020-04-28T12:31:56.496 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:31:56.497 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:56.536 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:56 +0000 (0:00:00.067) 0:01:08.298 ********* 2020-04-28T12:31:56.563 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:31:56.565 INFO:teuthology.task.ansible.out: 2020-04-28T12:31:56.605 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:56 +0000 (0:00:00.069) 0:01:08.368 ********* 2020-04-28T12:31:56.830 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-28T12:31:56.831 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:31:56.873 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:56 +0000 (0:00:00.268) 0:01:08.636 ********* 2020-04-28T12:31:57.029 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-28T12:31:57.030 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi197.front.sepia.ceph.com", "ansible_hostname": "smithi197", "ansible_nodename": "smithi197"}, "changed": true, "name": "smithi197"} 2020-04-28T12:31:57.070 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:57 +0000 (0:00:00.196) 0:01:08.832 ********* 2020-04-28T12:31:57.454 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-28T12:31:57.455 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:31:57.493 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:57 +0000 (0:00:00.422) 0:01:09.255 ********* 2020-04-28T12:31:57.519 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-28T12:31:57.521 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi066"}, "changed": false} 2020-04-28T12:31:57.557 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:57 +0000 (0:00:00.063) 0:01:09.319 ********* 2020-04-28T12:31:57.562 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-28T12:31:57.563 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:31:57.601 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:57 +0000 (0:00:00.044) 0:01:09.363 ********* 2020-04-28T12:31:58.064 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-28T12:31:58.065 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:31:58.107 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:58 +0000 (0:00:00.506) 0:01:09.869 ********* 2020-04-28T12:31:58.145 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-28T12:31:58.146 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi066", "ansible_hostname": "smithi066", "ansible_nodename": "smithi066"}, "changed": false, "name": "smithi066"} 2020-04-28T12:31:58.186 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:58 +0000 (0:00:00.078) 0:01:09.948 ********* 2020-04-28T12:31:58.682 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-28T12:31:58.683 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:31:58.718 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:58 +0000 (0:00:00.532) 0:01:10.480 ********* 2020-04-28T12:31:58.781 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-28T12:31:58.782 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:31:58.824 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:58 +0000 (0:00:00.106) 0:01:10.586 ********* 2020-04-28T12:31:59.212 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-28T12:31:59.213 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:31:59.253 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:59 +0000 (0:00:00.429) 0:01:11.015 ********* 2020-04-28T12:31:59.301 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-28T12:31:59.301 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:31:59.346 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:59 +0000 (0:00:00.090) 0:01:11.106 ********* 2020-04-28T12:31:59.549 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:31:59.550 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:31:59.586 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:59 +0000 (0:00:00.242) 0:01:11.348 ********* 2020-04-28T12:31:59.780 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:31:59.782 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:31:59.818 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:59 +0000 (0:00:00.232) 0:01:11.580 ********* 2020-04-28T12:31:59.938 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-28T12:31:59.938 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:31:59.978 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:31:59 +0000 (0:00:00.159) 0:01:11.740 ********* 2020-04-28T12:32:00.036 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:32:00.037 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:32:00.077 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:00 +0000 (0:00:00.099) 0:01:11.839 ********* 2020-04-28T12:32:00.467 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-28T12:32:00.468 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:32:00.506 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:00 +0000 (0:00:00.429) 0:01:12.268 ********* 2020-04-28T12:32:00.544 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:32:00.545 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:32:00.584 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:00 +0000 (0:00:00.077) 0:01:12.346 ********* 2020-04-28T12:32:00.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:32:00.715 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:32:00.753 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:00 +0000 (0:00:00.169) 0:01:12.516 ********* 2020-04-28T12:32:00.961 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:32:00.962 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:32:00.997 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:00 +0000 (0:00:00.243) 0:01:12.759 ********* 2020-04-28T12:32:01.080 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:32:01.119 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:01 +0000 (0:00:00.121) 0:01:12.881 ********* 2020-04-28T12:32:01.232 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:32:01.232 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:32:01.274 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:01 +0000 (0:00:00.155) 0:01:13.036 ********* 2020-04-28T12:32:01.773 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:32:01.774 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:32:01.829 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:01 +0000 (0:00:00.555) 0:01:13.592 ********* 2020-04-28T12:32:02.326 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:32:02.326 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:32:02.366 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:02 +0000 (0:00:00.536) 0:01:14.129 ********* 2020-04-28T12:32:02.908 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:32:02.909 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-28T12:32:02.910 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.596499", "end": "2020-04-28 12:32:02.883497", "rc": 0, "start": "2020-04-28 12:32:01.286998", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:02.954 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:02 +0000 (0:00:00.588) 0:01:14.717 ********* 2020-04-28T12:32:03.518 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:32:03.518 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-04-28T12:32:04.013 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-04-28T12:32:04.243 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:32:04.244 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.673690", "end": "2020-04-28 12:32:04.219132", "rc": 0, "start": "2020-04-28 12:32:02.545442", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:04.286 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:04 +0000 (0:00:01.331) 0:01:16.048 ********* 2020-04-28T12:32:04.497 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:32:04.498 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-04-28T12:32:04.539 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:04 +0000 (0:00:00.253) 0:01:16.301 ********* 2020-04-28T12:32:04.809 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-04-28T12:32:05.046 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-28T12:32:05.047 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:32:05.090 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:05 +0000 (0:00:00.547) 0:01:16.849 ********* 2020-04-28T12:32:05.294 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:32:05.294 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-04-28T12:32:05.586 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:32:05.587 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:32:05.768 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:32:05.769 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-04-28T12:32:05.807 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:05 +0000 (0:00:00.720) 0:01:17.569 ********* 2020-04-28T12:32:06.043 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:32:06.044 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:32:06.317 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi066.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:32:06.359 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:06 +0000 (0:00:00.551) 0:01:18.121 ********* 2020-04-28T12:32:06.501 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:32:06.502 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:32:06.554 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:06 +0000 (0:00:00.195) 0:01:18.316 ********* 2020-04-28T12:32:06.887 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:32:07.043 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-28T12:32:07.044 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.275117", "end": "2020-04-28 12:32:07.012976", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:32:06.737859", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-28T12:32:07.083 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.529) 0:01:18.845 ********* 2020-04-28T12:32:07.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-28T12:32:07.110 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:07.151 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.068) 0:01:18.914 ********* 2020-04-28T12:32:07.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-28T12:32:07.211 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:07.221 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:07.259 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.107) 0:01:19.021 ********* 2020-04-28T12:32:07.285 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-28T12:32:07.287 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:07.326 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.066) 0:01:19.088 ********* 2020-04-28T12:32:07.366 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:32:07.408 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.082) 0:01:19.170 ********* 2020-04-28T12:32:07.413 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:32:07.415 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:32:07.448 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-28T12:32:07.449 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:07.491 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.083) 0:01:19.253 ********* 2020-04-28T12:32:07.535 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-28T12:32:07.536 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:07.583 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.092) 0:01:19.345 ********* 2020-04-28T12:32:07.793 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-28T12:32:07.793 INFO:teuthology.task.ansible.out:fatal: [smithi197.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006393", "end": "2020-04-28 12:32:07.764525", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:32:07.758132", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:32:07.834 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.251) 0:01:19.597 ********* 2020-04-28T12:32:07.871 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-28T12:32:07.873 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:07.917 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.082) 0:01:19.680 ********* 2020-04-28T12:32:07.924 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:32:07.925 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:32:07.976 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:07 +0000 (0:00:00.059) 0:01:19.739 ********* 2020-04-28T12:32:08.508 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-28T12:32:08.509 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.296178", "end": "2020-04-28 12:32:08.478059", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:32:08.181881", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-28T12:32:08.551 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:08 +0000 (0:00:00.574) 0:01:20.313 ********* 2020-04-28T12:32:08.589 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-28T12:32:08.590 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:08.631 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:08 +0000 (0:00:00.077) 0:01:20.391 ********* 2020-04-28T12:32:08.676 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-28T12:32:08.677 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:08.685 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:08.722 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:08 +0000 (0:00:00.093) 0:01:20.484 ********* 2020-04-28T12:32:08.750 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:08.792 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:08 +0000 (0:00:00.070) 0:01:20.554 ********* 2020-04-28T12:32:08.830 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:08.832 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:32:08.870 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:08 +0000 (0:00:00.077) 0:01:20.632 ********* 2020-04-28T12:32:08.907 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-28T12:32:08.908 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:08.946 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:08 +0000 (0:00:00.076) 0:01:20.708 ********* 2020-04-28T12:32:08.983 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-28T12:32:08.985 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:09.023 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:09 +0000 (0:00:00.077) 0:01:20.786 ********* 2020-04-28T12:32:09.245 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-28T12:32:09.246 INFO:teuthology.task.ansible.out:fatal: [smithi066.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007019", "end": "2020-04-28 12:32:09.224017", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:32:09.216998", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:32:09.297 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:09 +0000 (0:00:00.273) 0:01:21.059 ********* 2020-04-28T12:32:09.336 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-28T12:32:09.337 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:09.374 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:09 +0000 (0:00:00.076) 0:01:21.136 ********* 2020-04-28T12:32:10.064 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:32:10.064 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64"]} 2020-04-28T12:32:10.106 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:10 +0000 (0:00:00.732) 0:01:21.869 ********* 2020-04-28T12:32:11.604 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64"]} 2020-04-28T12:32:11.643 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:11 +0000 (0:00:01.536) 0:01:23.405 ********* 2020-04-28T12:32:13.223 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-04-28T12:32:13.267 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:13 +0000 (0:00:01.624) 0:01:25.029 ********* 2020-04-28T12:32:14.716 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-04-28T12:32:14.777 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:14 +0000 (0:00:01.510) 0:01:26.539 ********* 2020-04-28T12:32:18.300 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.811219", "end": "2020-04-28 12:32:18.269933", "rc": 0, "start": "2020-04-28 12:32:13.458714", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 144 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 128 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 60 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 \nlab-extras 1.2 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:32:14 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base 2020-04-28T12:32:18.302 INFO:teuthology.task.ansible.out: \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 144 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 128 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 60 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 ", "lab-extras 1.2 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:32:14 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:32:18.345 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:18 +0000 (0:00:03.568) 0:01:30.107 ********* 2020-04-28T12:32:19.744 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.748995", "end": "2020-04-28 12:32:19.719462", "rc": 0, "start": "2020-04-28 12:32:14.970467", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 141 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 133 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 72 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 \nlab-extras 1.1 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:32:15 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n==================================================== 2020-04-28T12:32:19.746 INFO:teuthology.task.ansible.out:============================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 141 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 133 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 51 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 72 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 ", "lab-extras 1.1 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:32:15 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:32:19.789 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:19 +0000 (0:00:01.443) 0:01:31.551 ********* 2020-04-28T12:32:25.762 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:32:25.763 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64"]} 2020-04-28T12:32:25.804 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:25 +0000 (0:00:06.015) 0:01:37.566 ********* 2020-04-28T12:32:25.851 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:32:25.852 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:25.890 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:25 +0000 (0:00:00.085) 0:01:37.651 ********* 2020-04-28T12:32:26.847 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:32:26.849 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:32:26.890 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:26 +0000 (0:00:00.999) 0:01:38.651 ********* 2020-04-28T12:32:26.926 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:26.963 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:26 +0000 (0:00:00.074) 0:01:38.725 ********* 2020-04-28T12:32:27.288 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service sysinit.target system.slice basic.target dbus.socket dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ipset.service ip6tables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-04-28T12:32:27.292 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-04-28T12:32:27.294 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-04-28T12:32:27.295 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-28T12:32:27.335 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:27 +0000 (0:00:00.371) 0:01:39.097 ********* 2020-04-28T12:32:27.342 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:32:27.346 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64"]} 2020-04-28T12:32:27.390 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:27 +0000 (0:00:00.053) 0:01:39.151 ********* 2020-04-28T12:32:27.426 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:32:27.427 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:27.464 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:27 +0000 (0:00:00.075) 0:01:39.226 ********* 2020-04-28T12:32:27.634 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi197.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:32:27.672 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:27 +0000 (0:00:00.207) 0:01:39.434 ********* 2020-04-28T12:32:28.402 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-28T12:32:28.403 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-28T12:32:28.439 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.767) 0:01:40.201 ********* 2020-04-28T12:32:28.462 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:32:28.494 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.055) 0:01:40.257 ********* 2020-04-28T12:32:28.501 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-28T12:32:28.502 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:28.543 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.048) 0:01:40.305 ********* 2020-04-28T12:32:28.548 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:32:28.548 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:28.603 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.059) 0:01:40.365 ********* 2020-04-28T12:32:28.611 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-28T12:32:28.653 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.047) 0:01:40.413 ********* 2020-04-28T12:32:28.677 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-28T12:32:28.679 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:28.723 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.073) 0:01:40.486 ********* 2020-04-28T12:32:28.754 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:28.792 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.067) 0:01:40.553 ********* 2020-04-28T12:32:28.830 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-28T12:32:28.832 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:28.870 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.079) 0:01:40.632 ********* 2020-04-28T12:32:28.897 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-28T12:32:28.897 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:28.946 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.075) 0:01:40.708 ********* 2020-04-28T12:32:28.952 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-28T12:32:28.955 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket sysinit.target basic.target system.slice dbus.service polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ipset.service ip6tables.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-28T12:32:28.956 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", 2020-04-28T12:32:28.958 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-28T12:32:28.959 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-28T12:32:28.997 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:28 +0000 (0:00:00.051) 0:01:40.759 ********* 2020-04-28T12:32:29.003 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-28T12:32:29.046 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.048) 0:01:40.808 ********* 2020-04-28T12:32:29.073 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-28T12:32:29.074 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.112 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.066) 0:01:40.874 ********* 2020-04-28T12:32:29.140 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-28T12:32:29.142 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.178 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.065) 0:01:40.940 ********* 2020-04-28T12:32:29.204 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-28T12:32:29.205 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.244 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.065) 0:01:41.006 ********* 2020-04-28T12:32:29.279 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:32:29.281 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.315 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.071) 0:01:41.077 ********* 2020-04-28T12:32:29.356 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi066.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:32:29.360 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.401 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.085) 0:01:41.163 ********* 2020-04-28T12:32:29.442 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.039) 0:01:41.202 ********* 2020-04-28T12:32:29.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.507 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.066) 0:01:41.269 ********* 2020-04-28T12:32:29.535 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.574 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.067) 0:01:41.336 ********* 2020-04-28T12:32:29.611 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-28T12:32:29.627 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.654 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.079) 0:01:41.416 ********* 2020-04-28T12:32:29.682 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.719 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.065) 0:01:41.482 ********* 2020-04-28T12:32:29.724 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-28T12:32:29.725 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-28T12:32:29.764 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.044) 0:01:41.526 ********* 2020-04-28T12:32:29.770 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-28T12:32:29.770 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.810 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.046) 0:01:41.572 ********* 2020-04-28T12:32:29.819 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.856 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.045) 0:01:41.618 ********* 2020-04-28T12:32:29.861 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-28T12:32:29.863 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.900 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.044) 0:01:41.662 ********* 2020-04-28T12:32:29.905 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-28T12:32:29.943 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.043) 0:01:41.705 ********* 2020-04-28T12:32:29.949 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-28T12:32:29.950 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:29.988 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:29 +0000 (0:00:00.044) 0:01:41.750 ********* 2020-04-28T12:32:29.994 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-28T12:32:29.994 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.037 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.047) 0:01:41.798 ********* 2020-04-28T12:32:30.046 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.086 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.050) 0:01:41.848 ********* 2020-04-28T12:32:30.098 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.129 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.042) 0:01:41.891 ********* 2020-04-28T12:32:30.134 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-28T12:32:30.136 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.178 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.049) 0:01:41.941 ********* 2020-04-28T12:32:30.183 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-28T12:32:30.184 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.185 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.226 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.044) 0:01:41.986 ********* 2020-04-28T12:32:30.229 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.273 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.049) 0:01:42.035 ********* 2020-04-28T12:32:30.279 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-28T12:32:30.282 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.322 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.048) 0:01:42.084 ********* 2020-04-28T12:32:30.328 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:32:30.329 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.370 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.047) 0:01:42.132 ********* 2020-04-28T12:32:30.375 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-28T12:32:30.426 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.056) 0:01:42.188 ********* 2020-04-28T12:32:30.438 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.491 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.064) 0:01:42.253 ********* 2020-04-28T12:32:30.507 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.546 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.055) 0:01:42.309 ********* 2020-04-28T12:32:30.557 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.599 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.051) 0:01:42.360 ********* 2020-04-28T12:32:30.606 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.646 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.044) 0:01:42.405 ********* 2020-04-28T12:32:30.650 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.689 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.045) 0:01:42.451 ********* 2020-04-28T12:32:30.702 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.732 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.043) 0:01:42.495 ********* 2020-04-28T12:32:30.738 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:32:30.739 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.776 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.043) 0:01:42.538 ********* 2020-04-28T12:32:30.780 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:32:30.783 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.823 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.046) 0:01:42.585 ********* 2020-04-28T12:32:30.829 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:32:30.829 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.868 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.044) 0:01:42.630 ********* 2020-04-28T12:32:30.873 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-28T12:32:30.873 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.919 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.048) 0:01:42.679 ********* 2020-04-28T12:32:30.922 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:32:30.923 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:30.963 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:30 +0000 (0:00:00.046) 0:01:42.725 ********* 2020-04-28T12:32:30.968 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:32:30.970 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.011 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.047) 0:01:42.773 ********* 2020-04-28T12:32:31.020 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:31.020 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.058 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.047) 0:01:42.820 ********* 2020-04-28T12:32:31.064 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-28T12:32:31.064 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.103 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.045) 0:01:42.866 ********* 2020-04-28T12:32:31.109 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:32:31.110 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.160 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.056) 0:01:42.922 ********* 2020-04-28T12:32:31.166 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-28T12:32:31.166 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.204 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.044) 0:01:42.967 ********* 2020-04-28T12:32:31.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.249 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.044) 0:01:43.011 ********* 2020-04-28T12:32:31.256 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-28T12:32:31.262 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.293 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.044) 0:01:43.056 ********* 2020-04-28T12:32:31.301 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.339 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.044) 0:01:43.100 ********* 2020-04-28T12:32:31.344 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-28T12:32:31.345 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.382 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.044) 0:01:43.144 ********* 2020-04-28T12:32:31.390 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.426 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.043) 0:01:43.188 ********* 2020-04-28T12:32:31.431 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-28T12:32:31.433 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.469 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.043) 0:01:43.231 ********* 2020-04-28T12:32:31.523 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.559 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.090) 0:01:43.322 ********* 2020-04-28T12:32:31.586 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-28T12:32:31.587 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.631 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.072) 0:01:43.394 ********* 2020-04-28T12:32:31.658 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:32:31.660 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} TASK [testnode : Stop apache2] ************************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.711 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.079) 0:01:43.473 ********* 2020-04-28T12:32:31.752 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.041) 0:01:43.514 ********* 2020-04-28T12:32:31.757 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:32:31.759 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.800 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.047) 0:01:43.562 ********* 2020-04-28T12:32:31.829 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.868 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.067) 0:01:43.630 ********* 2020-04-28T12:32:31.894 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:32:31.896 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:31.934 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:31 +0000 (0:00:00.066) 0:01:43.696 ********* 2020-04-28T12:32:31.962 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:32:31.963 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.007 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.073) 0:01:43.769 ********* 2020-04-28T12:32:32.014 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:32:32.014 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:32:32.060 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.052) 0:01:43.822 ********* 2020-04-28T12:32:32.065 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:32:32.067 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.105 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.045) 0:01:43.868 ********* 2020-04-28T12:32:32.132 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:32:32.133 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.170 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.064) 0:01:43.932 ********* 2020-04-28T12:32:32.196 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:32:32.198 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.235 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.064) 0:01:43.997 ********* 2020-04-28T12:32:32.261 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:32:32.263 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:32:32.305 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.069) 0:01:44.067 ********* 2020-04-28T12:32:32.345 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.040) 0:01:44.107 ********* 2020-04-28T12:32:32.350 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:32.351 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.389 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.043) 0:01:44.151 ********* 2020-04-28T12:32:32.395 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:32:32.396 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.440 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.050) 0:01:44.202 ********* 2020-04-28T12:32:32.454 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.484 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.044) 0:01:44.246 ********* 2020-04-28T12:32:32.489 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:32:32.491 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.534 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.050) 0:01:44.296 ********* 2020-04-28T12:32:32.539 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:32:32.540 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.584 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.049) 0:01:44.346 ********* 2020-04-28T12:32:32.589 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:32:32.591 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.630 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.046) 0:01:44.392 ********* 2020-04-28T12:32:32.638 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:32:32.640 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.678 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.047) 0:01:44.440 ********* 2020-04-28T12:32:32.684 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:32:32.685 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.728 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.048) 0:01:44.489 ********* 2020-04-28T12:32:32.732 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:32:32.733 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.775 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.047) 0:01:44.537 ********* 2020-04-28T12:32:32.781 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:32:32.782 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.824 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.049) 0:01:44.587 ********* 2020-04-28T12:32:32.851 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:32:32.852 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.888 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.062) 0:01:44.649 ********* 2020-04-28T12:32:32.915 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:32:32.917 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:32.956 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:32 +0000 (0:00:00.069) 0:01:44.719 ********* 2020-04-28T12:32:32.994 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:32:32.996 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.043 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.086) 0:01:44.805 ********* 2020-04-28T12:32:33.048 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:32:33.049 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-28T12:32:33.096 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.052) 0:01:44.858 ********* 2020-04-28T12:32:33.101 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:32:33.102 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.141 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.046) 0:01:44.904 ********* 2020-04-28T12:32:33.167 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:32:33.169 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.207 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.065) 0:01:44.969 ********* 2020-04-28T12:32:33.233 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-28T12:32:33.234 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.275 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.068) 0:01:45.037 ********* 2020-04-28T12:32:33.304 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:32:33.306 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.350 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.075) 0:01:45.113 ********* 2020-04-28T12:32:33.357 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:32:33.396 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.045) 0:01:45.158 ********* 2020-04-28T12:32:33.402 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:32:33.405 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.447 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.050) 0:01:45.209 ********* 2020-04-28T12:32:33.474 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:32:33.475 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.515 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.068) 0:01:45.277 ********* 2020-04-28T12:32:33.541 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-28T12:32:33.543 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.581 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.065) 0:01:45.343 ********* 2020-04-28T12:32:33.607 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-28T12:32:33.608 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:32:33.646 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.064) 0:01:45.408 ********* 2020-04-28T12:32:33.683 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.036) 0:01:45.445 ********* 2020-04-28T12:32:33.688 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:32:33.690 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.730 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.045) 0:01:45.490 ********* 2020-04-28T12:32:33.735 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-28T12:32:33.735 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.774 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.046) 0:01:45.537 ********* 2020-04-28T12:32:33.783 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:32:33.784 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.824 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.049) 0:01:45.586 ********* 2020-04-28T12:32:33.830 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:32:33.832 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.872 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.048) 0:01:45.635 ********* 2020-04-28T12:32:33.878 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:32:33.880 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.920 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.047) 0:01:45.682 ********* 2020-04-28T12:32:33.926 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:32:33.927 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:33.967 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:33 +0000 (0:00:00.047) 0:01:45.729 ********* 2020-04-28T12:32:33.972 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:32:33.972 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.011 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.044) 0:01:45.774 ********* 2020-04-28T12:32:34.017 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-28T12:32:34.017 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.057 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.045) 0:01:45.819 ********* 2020-04-28T12:32:34.062 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:32:34.063 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.101 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.044) 0:01:45.863 ********* 2020-04-28T12:32:34.106 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:32:34.109 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.148 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.046) 0:01:45.910 ********* 2020-04-28T12:32:34.159 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.193 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.045) 0:01:45.955 ********* 2020-04-28T12:32:34.199 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-28T12:32:34.200 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.239 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.046) 0:01:46.001 ********* 2020-04-28T12:32:34.245 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.284 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.044) 0:01:46.046 ********* 2020-04-28T12:32:34.289 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:34.290 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-28T12:32:34.326 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.042) 0:01:46.089 ********* 2020-04-28T12:32:34.333 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:32:34.334 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.373 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.046) 0:01:46.135 ********* 2020-04-28T12:32:34.379 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:32:34.380 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.382 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-28T12:32:34.392 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.393 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:32:34.393 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.395 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi197.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.439 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.062) 0:01:46.197 ********* 2020-04-28T12:32:34.440 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.450 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.451 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.492 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.057) 0:01:46.254 ********* 2020-04-28T12:32:34.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:32:34.499 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.539 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.047) 0:01:46.302 ********* 2020-04-28T12:32:34.567 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.605 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.065) 0:01:46.367 ********* 2020-04-28T12:32:34.632 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:32:34.633 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi197.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003658", "end": "2020-04-28 12:32:34.611836", "rc": 0, "start": "2020-04-28 12:32:34.608178", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:32:34.671 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.066) 0:01:46.433 ********* 2020-04-28T12:32:34.711 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.039) 0:01:46.473 ********* 2020-04-28T12:32:34.717 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:32:34.718 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.763 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.052) 0:01:46.526 ********* 2020-04-28T12:32:34.769 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-28T12:32:34.770 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.813 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.049) 0:01:46.575 ********* 2020-04-28T12:32:34.819 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:32:34.819 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.858 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.045) 0:01:46.620 ********* 2020-04-28T12:32:34.866 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.907 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.049) 0:01:46.670 ********* 2020-04-28T12:32:34.913 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-28T12:32:34.914 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:34.958 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.050) 0:01:46.720 ********* 2020-04-28T12:32:34.962 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-28T12:32:34.963 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.003 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:34 +0000 (0:00:00.044) 0:01:46.765 ********* 2020-04-28T12:32:35.008 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-28T12:32:35.009 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.049 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.046) 0:01:46.811 ********* 2020-04-28T12:32:35.054 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-28T12:32:35.056 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.095 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.045) 0:01:46.857 ********* 2020-04-28T12:32:35.101 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-28T12:32:35.101 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.140 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.044) 0:01:46.902 ********* 2020-04-28T12:32:35.165 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:32:35.167 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.203 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.063) 0:01:46.965 ********* 2020-04-28T12:32:35.229 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:32:35.231 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.268 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.064) 0:01:47.030 ********* 2020-04-28T12:32:35.302 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.331 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.063) 0:01:47.093 ********* 2020-04-28T12:32:35.357 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:32:35.358 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.394 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.063) 0:01:47.156 ********* 2020-04-28T12:32:35.420 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-28T12:32:35.421 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.458 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.064) 0:01:47.220 ********* 2020-04-28T12:32:35.494 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:35.496 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-28T12:32:35.532 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.073) 0:01:47.294 ********* 2020-04-28T12:32:35.570 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:32:35.572 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.594 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-28T12:32:35.603 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.603 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.615 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.625 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.626 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.668 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.135) 0:01:47.430 ********* 2020-04-28T12:32:35.809 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-28T12:32:35.810 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003405", "end": "2020-04-28 12:32:35.786506", "rc": 0, "start": "2020-04-28 12:32:35.783101", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:32:35.852 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.180) 0:01:47.611 ********* 2020-04-28T12:32:35.885 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-28T12:32:35.886 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:35.928 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.079) 0:01:47.690 ********* 2020-04-28T12:32:35.964 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-28T12:32:35.966 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:36.004 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:35 +0000 (0:00:00.075) 0:01:47.766 ********* 2020-04-28T12:32:36.041 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:32:36.042 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:32:36.043 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:36.087 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:36 +0000 (0:00:00.083) 0:01:47.849 ********* 2020-04-28T12:32:36.130 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:36 +0000 (0:00:00.040) 0:01:47.890 ********* 2020-04-28T12:32:36.138 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:36.173 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:36 +0000 (0:00:00.045) 0:01:47.935 ********* 2020-04-28T12:32:36.181 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi197.front.sepia.ceph.com] => (item={u'block_used': 12898012, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227197096, u'size_available': 930599305216, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990338, u'device': u'/dev/sda1', u'inode_used': 64638, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227197096, "block_size": 4096, "block_total": 240095108, "block_used": 12898012, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990338, "inode_total": 61054976, "inode_used": 64638, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930599305216, "size_total": 983429562368, "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}} 2020-04-28T12:32:36.222 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:36 +0000 (0:00:00.047) 0:01:47.983 ********* 2020-04-28T12:32:36.430 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:32:36.432 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005207", "end": "2020-04-28 12:32:36.405638", "rc": 0, "start": "2020-04-28 12:32:36.400431", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:36.472 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:36 +0000 (0:00:00.251) 0:01:48.235 ********* 2020-04-28T12:32:36.509 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-28T12:32:36.510 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={u'block_used': 12898012, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227197096, u'size_available': 930599305216, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990338, u'device': u'/dev/sda1', u'inode_used': 64638, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227197096, "block_size": 4096, "block_total": 240095108, "block_used": 12898012, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990338, "inode_total": 61054976, "inode_used": 64638, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930599305216, "size_total": 983429562368, "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:36.554 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:36 +0000 (0:00:00.081) 0:01:48.316 ********* 2020-04-28T12:32:36.599 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:32:36.647 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:36 +0000 (0:00:00.092) 0:01:48.408 ********* 2020-04-28T12:32:36.700 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:32:36.701 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK3R', u'wwn-0x5000c5009293d217'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XK3R', u'wwn': u'0x5000c5009293d217', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1', u'wwn-0x5000c5009293d217-part1'], u'uuids': [u'8d3686dd-76b5-4c64-849f-a78d45585295']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R", "wwn-0x5000c5009293d217"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1", "wwn-0x5000c5009293d217-part1"], "labels": [], "masters": [], "uuids": ["8d3686dd-76b5-4c64-849f-a78d45585295"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XK3R", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:32:36.703 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c5009293d217"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:37.182 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:32:37.183 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:32:37.220 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:37 +0000 (0:00:00.573) 0:01:48.982 ********* 2020-04-28T12:32:37.268 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:32:37.269 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={u'block_used': 12898021, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227197087, u'size_available': 930599268352, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990339, u'device': u'/dev/sda1', u'inode_used': 64637, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227197087, "block_size": 4096, "block_total": 240095108, "block_used": 12898021, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990339, "inode_total": 61054976, "inode_used": 64637, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930599268352, "size_total": 983429562368, "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}} 2020-04-28T12:32:37.320 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:37 +0000 (0:00:00.099) 0:01:49.082 ********* 2020-04-28T12:32:37.541 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:32:37.543 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005364", "end": "2020-04-28 12:32:37.518055", "rc": 0, "start": "2020-04-28 12:32:37.512691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:37.581 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:37 +0000 (0:00:00.261) 0:01:49.343 ********* 2020-04-28T12:32:37.624 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-28T12:32:37.625 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={u'block_used': 12898021, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227197087, u'size_available': 930599268352, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990339, u'device': u'/dev/sda1', u'inode_used': 64637, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227197087, "block_size": 4096, "block_total": 240095108, "block_used": 12898021, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990339, "inode_total": 61054976, "inode_used": 64637, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930599268352, "size_total": 983429562368, "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:37.664 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:37 +0000 (0:00:00.083) 0:01:49.427 ********* 2020-04-28T12:32:37.691 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:32:37.728 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:37 +0000 (0:00:00.063) 0:01:49.490 ********* 2020-04-28T12:32:37.778 INFO:teuthology.task.ansible.out: 2020-04-28T12:32:37.779 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:32:37.783 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W2RJ', u'wwn-0x5000c50087b90a26'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4W2RJ', u'wwn': u'0x5000c50087b90a26', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1', u'wwn-0x5000c50087b90a26-part1'], u'uuids': [u'8d3686dd-76b5-4c64-849f-a78d45585295']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ", "wwn-0x5000c50087b90a26"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1", "wwn-0x5000c50087b90a26-part1"], "labels": [], "masters": [], "uuids": ["8d3686dd-76b5-4c64-849f-a78d45585295"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2RJ", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:32:37.784 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50087b90a26"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:38.325 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-deLvQP-jb4S-vD4k-lVhe-P6P2-qV9a-Bz49Ly', u'nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN', u'nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.436984", "end": "2020-04-28 12:32:38.294247", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-deLvQP-jb4S-vD4k-lVhe-P6P2-qV9a-Bz49Ly", "nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN", "nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:36.857263", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:32:38.327 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:39.382 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-boo4x0-3XS2-UBtT-Wgis-dILE-VDYk-CQhMAe', u'nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN', u'nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.396534", "end": "2020-04-28 12:32:39.350401", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-boo4x0-3XS2-UBtT-Wgis-dILE-VDYk-CQhMAe", "nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN", "nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:37.953867", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:32:39.384 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:39.591 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAKhvpy2hV7x6BOSOPUYIBYIrdhublG7e3'], u'uuids': [u'015ff6a4-dfde-4dd3-a9dc-9cfbbf42eeb5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.060890", "end": "2020-04-28 12:32:39.554430", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAKhvpy2hV7x6BOSOPUYIBYIrdhublG7e3"], "labels": [], "masters": [], "uuids": ["015ff6a4-dfde-4dd3-a9dc-9cfbbf42eeb5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:38.493540", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:40.658 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQsVmukejiKu1PpSugwrk0tBGQBKS7z7zB'], u'uuids': [u'90a3124b-19b1-4ab3-a367-9b89cbd529b2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.057339", "end": "2020-04-28 12:32:40.620086", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQsVmukejiKu1PpSugwrk0tBGQBKS7z7zB"], "labels": [], "masters": [], "uuids": ["90a3124b-19b1-4ab3-a367-9b89cbd529b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:39.562747", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:40.845 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JACK16MULkr1iCPvbqk2ECxYlilWTf1XdV'], u'uuids': [u'ac90e3f3-50d0-4c64-8d32-c89f185d3797']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.048758", "end": "2020-04-28 12:32:40.803393", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JACK16MULkr1iCPvbqk2ECxYlilWTf1XdV"], "labels": [], "masters": [], "uuids": ["ac90e3f3-50d0-4c64-8d32-c89f185d3797"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:39.754635", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:41.939 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQ2GOhxKaQ7ZnzfuIMI96j466PwY02z8M1'], u'uuids': [u'99815042-bc3b-412e-953d-0b9d111357b4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.067289", "end": "2020-04-28 12:32:41.894792", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQ2GOhxKaQ7ZnzfuIMI96j466PwY02z8M1"], "labels": [], "masters": [], "uuids": ["99815042-bc3b-412e-953d-0b9d111357b4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:40.827503", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:42.097 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JA9O3n8MKH8ujm7bhNIWHRp4n1WHTNU0dB'], u'uuids': [u'58b87106-5461-4fda-bed6-4701a5e74d48']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.053405", "end": "2020-04-28 12:32:42.061128", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JA9O3n8MKH8ujm7bhNIWHRp4n1WHTNU0dB"], "labels": [], "masters": [], "uuids": ["58b87106-5461-4fda-bed6-4701a5e74d48"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:41.007723", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:43.195 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQtSITyyeWMkTkv0f3DjkJS74N0v6dfTtB'], u'uuids': [u'495dbb09-9e8d-46d7-8993-5d45bf087e45']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.047545", "end": "2020-04-28 12:32:43.154114", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQtSITyyeWMkTkv0f3DjkJS74N0v6dfTtB"], "labels": [], "masters": [], "uuids": ["495dbb09-9e8d-46d7-8993-5d45bf087e45"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:42.106569", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:43.334 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAf40ptzkrhSyM6n7PayQ3F2QKVlWB4kHp'], u'uuids': [u'32bab409-7afc-4292-86d9-1c958ee3154e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.042936", "end": "2020-04-28 12:32:43.302931", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAf40ptzkrhSyM6n7PayQ3F2QKVlWB4kHp"], "labels": [], "masters": [], "uuids": ["32bab409-7afc-4292-86d9-1c958ee3154e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:42.259995", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:44.459 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQYnp4RuAqY2Mgj1FhmBBME36rQnRP3Pht'], u'uuids': [u'6f02e198-9cb8-43e6-b35f-be2b1fa250ab']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.051941", "end": "2020-04-28 12:32:44.420883", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQYnp4RuAqY2Mgj1FhmBBME36rQnRP3Pht"], "labels": [], "masters": [], "uuids": ["6f02e198-9cb8-43e6-b35f-be2b1fa250ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:43.368942", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:44.606 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAvbZ9DHHThrBK2dcSOfocGhRGVvdv4mPK'], u'uuids': [u'a13af9c6-69f9-47d7-b5e7-2af6829c1b82']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.065296", "end": "2020-04-28 12:32:44.571148", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAvbZ9DHHThrBK2dcSOfocGhRGVvdv4mPK"], "labels": [], "masters": [], "uuids": ["a13af9c6-69f9-47d7-b5e7-2af6829c1b82"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:43.505852", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:44.666 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:44 +0000 (0:00:06.934) 0:01:56.425 ********* 2020-04-28T12:32:44.714 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK3R', u'wwn-0x5000c5009293d217'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XK3R', u'wwn': u'0x5000c5009293d217', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1', u'wwn-0x5000c5009293d217-part1'], u'uuids': [u'8d3686dd-76b5-4c64-849f-a78d45585295']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R", "wwn-0x5000c5009293d217"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1", "wwn-0x5000c5009293d217-part1"], "labels": [], "masters": [], "uuids": ["8d3686dd-76b5-4c64-849f-a78d45585295"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsi 2020-04-28T12:32:44.716 INFO:teuthology.task.ansible.out:ze": "512", "serial": "Z1W5XK3R", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d217"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:44.943 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-deLvQP-jb4S-vD4k-lVhe-P6P2-qV9a-Bz49Ly', u'nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN', u'nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037900", "end": "2020-04-28 12:32:44.911027", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-deLvQP-jb4S-vD4k-lVhe-P6P2-qV9a-Bz49Ly", "nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN", "nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:44.873127", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:32:44.945 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0352389 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0352389 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:45.272 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAKhvpy2hV7x6BOSOPUYIBYIrdhublG7e3'], u'uuids': [u'015ff6a4-dfde-4dd3-a9dc-9cfbbf42eeb5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.138670", "end": "2020-04-28 12:32:45.237541", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAKhvpy2hV7x6BOSOPUYIBYIrdhublG7e3"], "labels": [], "masters": [], "uuids": ["015ff6a4-dfde-4dd3-a9dc-9cfbbf42eeb5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:45.098871", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136003 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136003 s, 848 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:45.614 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JACK16MULkr1iCPvbqk2ECxYlilWTf1XdV'], u'uuids': [u'ac90e3f3-50d0-4c64-8d32-c89f185d3797']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.148346", "end": "2020-04-28 12:32:45.576750", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JACK16MULkr1iCPvbqk2ECxYlilWTf1XdV"], "labels": [], "masters": [], "uuids": ["ac90e3f3-50d0-4c64-8d32-c89f185d3797"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:45.428404", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.145911 s, 791 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.145911 s, 791 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:45.762 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:32:45.763 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQhqu6mcygZPBHoIdsIZHTMcuudRlNV09Y'], u'uuids': [u'caf97116-2f66-4edd-8871-3e6e1d6802c8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.087331", "end": "2020-04-28 12:32:45.721354", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQhqu6mcygZPBHoIdsIZHTMcuudRlNV09Y"], "labels": [], "masters": [], "uuids": ["caf97116-2f66-4edd-8871-3e6e1d6802c8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:44.634023", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:32:45.833 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:45 +0000 (0:00:01.168) 0:01:57.593 ********* 2020-04-28T12:32:45.880 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:32:45.881 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W2RJ', u'wwn-0x5000c50087b90a26'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4W2RJ', u'wwn': u'0x5000c50087b90a26', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1', u'wwn-0x5000c50087b90a26-part1'], u'uuids': [u'8d3686dd-76b5-4c64-849f-a78d45585295']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ", "wwn-0x5000c50087b90a26"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1", "wwn-0x5000c50087b90a26-part1"], "labels": [], "masters": [], "uuids": ["8d3686dd-76b5-4c64-849f-a78d45585295"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2RJ", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:32:45.883 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50087b90a26"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:45.971 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JA9O3n8MKH8ujm7bhNIWHRp4n1WHTNU0dB'], u'uuids': [u'58b87106-5461-4fda-bed6-4701a5e74d48']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138005", "end": "2020-04-28 12:32:45.910488", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JA9O3n8MKH8ujm7bhNIWHRp4n1WHTNU0dB"], "labels": [], "masters": [], "uuids": ["58b87106-5461-4fda-bed6-4701a5e74d48"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:45.772483", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135343 s, 852 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135343 s, 852 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:46.124 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-boo4x0-3XS2-UBtT-Wgis-dILE-VDYk-CQhMAe', u'nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN', u'nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037020", "end": "2020-04-28 12:32:46.099538", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-boo4x0-3XS2-UBtT-Wgis-dILE-VDYk-CQhMAe", "nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN", "nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:46.062518", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:32:46.126 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0340807 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0340807 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:46.297 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAf40ptzkrhSyM6n7PayQ3F2QKVlWB4kHp'], u'uuids': [u'32bab409-7afc-4292-86d9-1c958ee3154e']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.149309", "end": "2020-04-28 12:32:46.271073", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAf40ptzkrhSyM6n7PayQ3F2QKVlWB4kHp"], "labels": [], "masters": [], "uuids": ["32bab409-7afc-4292-86d9-1c958ee3154e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:46.121764", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146815 s, 786 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146815 s, 786 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:46.466 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQsVmukejiKu1PpSugwrk0tBGQBKS7z7zB'], u'uuids': [u'90a3124b-19b1-4ab3-a367-9b89cbd529b2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139978", "end": "2020-04-28 12:32:46.438917", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQsVmukejiKu1PpSugwrk0tBGQBKS7z7zB"], "labels": [], "masters": [], "uuids": ["90a3124b-19b1-4ab3-a367-9b89cbd529b2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:46.298939", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137317 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137317 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:46.634 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAvbZ9DHHThrBK2dcSOfocGhRGVvdv4mPK'], u'uuids': [u'a13af9c6-69f9-47d7-b5e7-2af6829c1b82']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138714", "end": "2020-04-28 12:32:46.594741", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-e1YDd4nU0tWSPKVgdPIbaRVcyk0fn6JAvbZ9DHHThrBK2dcSOfocGhRGVvdv4mPK"], "labels": [], "masters": [], "uuids": ["a13af9c6-69f9-47d7-b5e7-2af6829c1b82"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:46.456027", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136099 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136099 s, 847 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:46.695 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:46 +0000 (0:00:00.863) 0:01:58.457 ********* 2020-04-28T12:32:46.819 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQ2GOhxKaQ7ZnzfuIMI96j466PwY02z8M1'], u'uuids': [u'99815042-bc3b-412e-953d-0b9d111357b4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138755", "end": "2020-04-28 12:32:46.784100", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQ2GOhxKaQ7ZnzfuIMI96j466PwY02z8M1"], "labels": [], "masters": [], "uuids": ["99815042-bc3b-412e-953d-0b9d111357b4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:46.645345", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135938 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135938 s, 848 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:46.967 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.066833", "end": "2020-04-28 12:32:46.937943", "rc": 0, "start": "2020-04-28 12:32:46.871110", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:47.005 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:46 +0000 (0:00:00.310) 0:01:58.767 ********* 2020-04-28T12:32:47.170 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQtSITyyeWMkTkv0f3DjkJS74N0v6dfTtB'], u'uuids': [u'495dbb09-9e8d-46d7-8993-5d45bf087e45']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146684", "end": "2020-04-28 12:32:47.132075", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQtSITyyeWMkTkv0f3DjkJS74N0v6dfTtB"], "labels": [], "masters": [], "uuids": ["495dbb09-9e8d-46d7-8993-5d45bf087e45"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:46.985391", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144063 s, 801 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144063 s, 801 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:47.247 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.042465", "end": "2020-04-28 12:32:47.218774", "rc": 0, "start": "2020-04-28 12:32:47.176309", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:47.293 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.287) 0:01:59.055 ********* 2020-04-28T12:32:47.322 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:32:47.367 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.073) 0:01:59.128 ********* 2020-04-28T12:32:47.404 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:47.448 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.081) 0:01:59.210 ********* 2020-04-28T12:32:47.494 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:47.536 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.087) 0:01:59.298 ********* 2020-04-28T12:32:47.542 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:32:47.543 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQYnp4RuAqY2Mgj1FhmBBME36rQnRP3Pht'], u'uuids': [u'6f02e198-9cb8-43e6-b35f-be2b1fa250ab']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140372", "end": "2020-04-28 12:32:47.478386", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQYnp4RuAqY2Mgj1FhmBBME36rQnRP3Pht"], "labels": [], "masters": [], "uuids": ["6f02e198-9cb8-43e6-b35f-be2b1fa250ab"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:47.338014", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137724 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137724 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:47.570 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:47.614 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.078) 0:01:59.376 ********* 2020-04-28T12:32:47.652 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:47.713 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.098) 0:01:59.475 ********* 2020-04-28T12:32:47.870 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQhqu6mcygZPBHoIdsIZHTMcuudRlNV09Y'], u'uuids': [u'caf97116-2f66-4edd-8871-3e6e1d6802c8']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137510", "end": "2020-04-28 12:32:47.828163", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-NknDlRgoIrJ0LdVNHkdFQ1qvWbyw0RsQhqu6mcygZPBHoIdsIZHTMcuudRlNV09Y"], "labels": [], "masters": [], "uuids": ["caf97116-2f66-4edd-8871-3e6e1d6802c8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:32:47.690653", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134846 s, 855 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134846 s, 855 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:47.925 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.212) 0:01:59.688 ********* 2020-04-28T12:32:47.933 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:32:47.974 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:47 +0000 (0:00:00.048) 0:01:59.736 ********* 2020-04-28T12:32:48.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi197.front.sepia.ceph.com] => (item={u'block_used': 12898012, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227197096, u'size_available': 930599305216, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990338, u'device': u'/dev/sda1', u'inode_used': 64638, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227197096, "block_size": 4096, "block_total": 240095108, "block_used": 12898012, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990338, "inode_total": 61054976, "inode_used": 64638, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930599305216, "size_total": 983429562368, "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.067 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.089) 0:01:59.825 ********* 2020-04-28T12:32:48.100 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-28T12:32:48.106 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.140 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.076) 0:01:59.902 ********* 2020-04-28T12:32:48.167 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:48.168 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.211 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.071) 0:01:59.973 ********* 2020-04-28T12:32:48.217 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-28T12:32:48.217 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.061457", "end": "2020-04-28 12:32:48.168772", "rc": 0, "start": "2020-04-28 12:32:48.107315", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:48.257 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.046) 0:02:00.020 ********* 2020-04-28T12:32:48.263 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:48.264 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.305 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.047) 0:02:00.067 ********* 2020-04-28T12:32:48.344 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-28T12:32:48.347 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.383 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.077) 0:02:00.145 ********* 2020-04-28T12:32:48.431 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.467 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.084) 0:02:00.230 ********* 2020-04-28T12:32:48.505 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-28T12:32:48.508 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.545 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.077) 0:02:00.307 ********* 2020-04-28T12:32:48.551 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-28T12:32:48.553 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.060918", "end": "2020-04-28 12:32:48.499502", "rc": 0, "start": "2020-04-28 12:32:48.438584", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:32:48.595 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.049) 0:02:00.357 ********* 2020-04-28T12:32:48.626 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:32:48.666 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.070) 0:02:00.428 ********* 2020-04-28T12:32:48.710 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.762 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.096) 0:02:00.525 ********* 2020-04-28T12:32:48.805 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.845 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.082) 0:02:00.607 ********* 2020-04-28T12:32:48.878 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.920 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.075) 0:02:00.683 ********* 2020-04-28T12:32:48.949 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:48.992 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:48 +0000 (0:00:00.070) 0:02:00.754 ********* 2020-04-28T12:32:49.207 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-28T12:32:49.209 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:32:49.245 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.253) 0:02:01.007 ********* 2020-04-28T12:32:49.285 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => (item={u'block_used': 12898021, u'uuid': u'8d3686dd-76b5-4c64-849f-a78d45585295', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227197087, u'size_available': 930599268352, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60990339, u'device': u'/dev/sda1', u'inode_used': 64637, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227197087, "block_size": 4096, "block_total": 240095108, "block_used": 12898021, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990339, "inode_total": 61054976, "inode_used": 64637, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930599268352, "size_total": 983429562368, "uuid": "8d3686dd-76b5-4c64-849f-a78d45585295"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:49.342 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.095) 0:02:01.102 ********* 2020-04-28T12:32:49.346 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-28T12:32:49.347 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:32:49.389 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.046) 0:02:01.148 ********* 2020-04-28T12:32:49.391 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-04-28T12:32:49.392 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:49.433 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.046) 0:02:01.195 ********* 2020-04-28T12:32:49.464 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:49.505 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.069) 0:02:01.264 ********* 2020-04-28T12:32:49.553 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:49.606 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.103) 0:02:01.367 ********* 2020-04-28T12:32:49.653 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:49.697 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.087) 0:02:01.454 ********* 2020-04-28T12:32:49.734 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-28T12:32:49.736 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:49.777 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.085) 0:02:01.540 ********* 2020-04-28T12:32:49.806 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-28T12:32:49.809 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:49.842 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:49 +0000 (0:00:00.064) 0:02:01.604 ********* 2020-04-28T12:32:50.089 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:50.311 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:32:50.358 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:50 +0000 (0:00:00.516) 0:02:02.121 ********* 2020-04-28T12:32:50.438 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:32:50.439 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:50.779 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:50.823 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:51.134 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:51.170 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:51.477 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:51.513 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:51.577 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:51 +0000 (0:00:01.218) 0:02:03.339 ********* 2020-04-28T12:32:51.784 INFO:teuthology.task.ansible.out: 2020-04-28T12:32:51.787 INFO:teuthology.task.ansible.out:TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:32:51.788 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:32:51.835 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:51 +0000 (0:00:00.258) 0:02:03.598 ********* 2020-04-28T12:32:51.874 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:51.884 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-28T12:32:51.885 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:52.075 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:52.242 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:32:52.286 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:52 +0000 (0:00:00.450) 0:02:04.048 ********* 2020-04-28T12:32:52.295 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:52.442 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:52.505 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:32:52.506 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:32:52.547 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:52 +0000 (0:00:00.260) 0:02:04.309 ********* 2020-04-28T12:32:52.596 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-28T12:32:52.598 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:52.633 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:52.681 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:52 +0000 (0:00:00.133) 0:02:04.443 ********* 2020-04-28T12:32:52.826 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:52.879 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-28T12:32:52.881 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:32:52.921 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:52 +0000 (0:00:00.239) 0:02:04.683 ********* 2020-04-28T12:32:52.963 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:32:53.013 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:53 +0000 (0:00:00.092) 0:02:04.776 ********* 2020-04-28T12:32:53.027 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:53.222 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:53.424 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:32:53.481 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:53 +0000 (0:00:00.467) 0:02:05.244 ********* 2020-04-28T12:32:53.707 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-28T12:32:53.707 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:32:53.745 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:53 +0000 (0:00:00.263) 0:02:05.507 ********* 2020-04-28T12:32:53.795 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-28T12:32:53.797 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:32:53.834 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:53 +0000 (0:00:00.088) 0:02:05.596 ********* 2020-04-28T12:32:54.151 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-28T12:32:54.153 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true} 2020-04-28T12:32:54.196 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:54 +0000 (0:00:00.361) 0:02:05.958 ********* 2020-04-28T12:32:54.662 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true} 2020-04-28T12:32:54.700 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:54 +0000 (0:00:00.504) 0:02:06.463 ********* 2020-04-28T12:32:54.813 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:32:54.815 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:32:54.857 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:54 +0000 (0:00:00.156) 0:02:06.619 ********* 2020-04-28T12:32:54.883 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:32:54.884 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:54.923 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:54 +0000 (0:00:00.066) 0:02:06.686 ********* 2020-04-28T12:32:54.950 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-28T12:32:54.952 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:54.989 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:54 +0000 (0:00:00.065) 0:02:06.751 ********* 2020-04-28T12:32:55.016 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:32:55.017 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.054 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.065) 0:02:06.817 ********* 2020-04-28T12:32:55.060 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:32:55.061 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:32:55.103 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.048) 0:02:06.866 ********* 2020-04-28T12:32:55.109 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-28T12:32:55.111 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.151 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.048) 0:02:06.914 ********* 2020-04-28T12:32:55.157 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:32:55.158 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.196 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.044) 0:02:06.958 ********* 2020-04-28T12:32:55.203 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.240 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.044) 0:02:07.002 ********* 2020-04-28T12:32:55.257 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-28T12:32:55.258 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.295 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.054) 0:02:07.057 ********* 2020-04-28T12:32:55.300 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-28T12:32:55.302 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.340 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.045) 0:02:07.103 ********* 2020-04-28T12:32:55.347 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:32:55.348 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.387 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.046) 0:02:07.150 ********* 2020-04-28T12:32:55.393 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-28T12:32:55.394 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.433 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.045) 0:02:07.196 ********* 2020-04-28T12:32:55.439 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-04-28T12:32:55.441 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.481 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.048) 0:02:07.244 ********* 2020-04-28T12:32:55.487 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-28T12:32:55.489 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.529 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.047) 0:02:07.291 ********* 2020-04-28T12:32:55.534 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-28T12:32:55.536 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.572 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.043) 0:02:07.335 ********* 2020-04-28T12:32:55.581 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-28T12:32:55.583 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.619 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.046) 0:02:07.381 ********* 2020-04-28T12:32:55.630 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.664 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.044) 0:02:07.426 ********* 2020-04-28T12:32:55.669 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:32:55.669 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.709 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.044) 0:02:07.470 ********* 2020-04-28T12:32:55.714 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-28T12:32:55.716 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.754 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.046) 0:02:07.517 ********* 2020-04-28T12:32:55.761 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:32:55.762 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.803 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.048) 0:02:07.565 ********* 2020-04-28T12:32:55.810 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-28T12:32:55.811 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.852 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.048) 0:02:07.614 ********* 2020-04-28T12:32:55.879 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-28T12:32:55.880 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.924 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.072) 0:02:07.687 ********* 2020-04-28T12:32:55.951 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:32:55.952 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:55.991 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:55 +0000 (0:00:00.066) 0:02:07.753 ********* 2020-04-28T12:32:56.018 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:32:56.019 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:56.057 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:56 +0000 (0:00:00.065) 0:02:07.819 ********* 2020-04-28T12:32:56.338 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-28T12:32:56.338 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:32:56.379 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:56 +0000 (0:00:00.322) 0:02:08.142 ********* 2020-04-28T12:32:56.560 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:32:56.598 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:56 +0000 (0:00:00.218) 0:02:08.360 ********* 2020-04-28T12:32:56.711 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:29:37 UTC", "ActiveEnterTimestampMonotonic": "12822155", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket ntpdate.service systemd-tmpfiles-setup.service ntpd.service basic.target -.mount system.slice tmp.mount sntp.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:29:37 UTC", "AssertTimestampMonotonic": "12442154", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:29:37 UTC", "ConditionTimestampMonotonic": "12442128", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.servic 2020-04-28T12:32:56.712 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2420", "ExecMainStartTimestamp": "Tue 2020-04-28 12:29:37 UTC", "ExecMainStartTimestampMonotonic": "12756520", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:29:37 UTC", "InactiveExitTimestampMonotonic": "12466508", "InvocationID": "3cbdc05c85aa4bcfa3c1ffa8c01dbeb2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infini 2020-04-28T12:32:56.714 INFO:teuthology.task.ansible.out:ty", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2420", "MemoryAccounting": "yes", "MemoryCurrent": "2650112", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits" 2020-04-28T12:32:56.715 INFO:teuthology.task.ansible.out:: "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:29:37 UTC", "StateChangeTimestampMonotonic": "12822155", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:29:37 UTC", "WatchdogTimestampMonotonic": "12756529", "WatchdogUSec": "0"}} 2020-04-28T12:32:56.749 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:56 +0000 (0:00:00.151) 0:02:08.511 ********* 2020-04-28T12:32:56.778 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:56.779 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:32:56.824 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:56 +0000 (0:00:00.072) 0:02:08.584 ********* 2020-04-28T12:32:56.862 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:56.867 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:32:56.903 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:56 +0000 (0:00:00.081) 0:02:08.665 ********* 2020-04-28T12:32:56.922 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-28T12:32:56.925 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:29:46 UTC", "ActiveEnterTimestampMonotonic": "14118621", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpdate.service systemd-tmpfiles-setup.service basic.target tmp.mount systemd-journald.socket sysinit.target ntpd.service -.mount system.slice sntp.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:29:45 UTC", "AssertTimestampMonotonic": "12897566", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:29:45 UTC", "ConditionTimestampMonotonic": "12897535", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-28T12:32:56.926 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2407", "ExecMainStartTimestamp": "Tue 2020-04-28 12:29:45 UTC", "ExecMainStartTimestampMonotonic": "13084783", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:29:45 UTC", "InactiveExitTimestampMonotonic": "12920995", "InvocationID": "fb387359e17248548fe578f96e177aa1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-28T12:32:56.928 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2407", "MemoryAccounting": "yes", "MemoryCurrent": "3076096", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-28T12:32:56.929 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:29:46 UTC", "StateChangeTimestampMonotonic": "14118621", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type 2020-04-28T12:32:56.929 INFO:teuthology.task.ansible.out:": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:29:45 UTC", "WatchdogTimestampMonotonic": "13084792", "WatchdogUSec": "0"}} 2020-04-28T12:32:56.934 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-28T12:32:56.935 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:56.974 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:56 +0000 (0:00:00.070) 0:02:08.735 ********* 2020-04-28T12:32:57.014 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.040) 0:02:08.776 ********* 2020-04-28T12:32:57.019 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-28T12:32:57.021 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:57.059 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.044) 0:02:08.821 ********* 2020-04-28T12:32:57.069 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:32:57.104 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.044) 0:02:08.866 ********* 2020-04-28T12:32:57.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:32:57.117 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:57.153 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.048) 0:02:08.915 ********* 2020-04-28T12:32:57.158 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:32:57.160 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:32:57.197 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.044) 0:02:08.959 ********* 2020-04-28T12:32:57.234 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-28T12:32:57.235 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:57.270 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.072) 0:02:09.032 ********* 2020-04-28T12:32:57.296 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-28T12:32:57.298 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:57.334 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.064) 0:02:09.097 ********* 2020-04-28T12:32:57.372 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:32:57.380 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:57.410 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.075) 0:02:09.172 ********* 2020-04-28T12:32:57.416 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-04-28T12:32:57.417 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:32:57.457 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.047) 0:02:09.219 ********* 2020-04-28T12:32:57.620 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:32:57.660 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:57 +0000 (0:00:00.203) 0:02:09.423 ********* 2020-04-28T12:32:58.003 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-28T12:32:58.004 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:32:58.052 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:58 +0000 (0:00:00.391) 0:02:09.814 ********* 2020-04-28T12:32:58.164 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:32:58.205 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:58 +0000 (0:00:00.153) 0:02:09.967 ********* 2020-04-28T12:32:59.410 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-28T12:32:59.411 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:32:59.456 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:01.251) 0:02:11.219 ********* 2020-04-28T12:32:59.471 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:32:59.519 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:00.057) 0:02:11.276 ********* 2020-04-28T12:32:59.520 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-28T12:32:59.520 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:59.568 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:00.054) 0:02:11.331 ********* 2020-04-28T12:32:59.574 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:32:59.614 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:00.045) 0:02:11.376 ********* 2020-04-28T12:32:59.619 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-28T12:32:59.620 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-28T12:32:59.658 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:00.044) 0:02:11.420 ********* 2020-04-28T12:32:59.667 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-28T12:32:59.705 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:00.047) 0:02:11.467 ********* 2020-04-28T12:32:59.858 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-28T12:32:59.860 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:32:59.919 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:00.209) 0:02:11.677 ********* 2020-04-28T12:32:59.923 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:32:59.963 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:32:59 +0000 (0:00:00.048) 0:02:11.725 ********* 2020-04-28T12:32:59.969 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-28T12:32:59.975 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.009 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.045) 0:02:11.771 ********* 2020-04-28T12:33:00.015 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.054 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.044) 0:02:11.816 ********* 2020-04-28T12:33:00.063 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:33:00.101 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.047) 0:02:11.863 ********* 2020-04-28T12:33:00.110 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:33:00.146 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.044) 0:02:11.908 ********* 2020-04-28T12:33:00.152 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-28T12:33:00.153 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.192 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.046) 0:02:11.954 ********* 2020-04-28T12:33:00.198 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.236 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.044) 0:02:11.999 ********* 2020-04-28T12:33:00.389 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-28T12:33:00.390 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:33:00.437 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.195) 0:02:12.194 ********* 2020-04-28T12:33:00.449 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:33:00.514 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.081) 0:02:12.276 ********* 2020-04-28T12:33:00.636 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-28T12:33:00.638 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:33:00.689 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.175) 0:02:12.451 ********* 2020-04-28T12:33:00.718 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-28T12:33:00.720 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.758 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.067) 0:02:12.519 ********* 2020-04-28T12:33:00.770 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:33:00.807 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.049) 0:02:12.569 ********* 2020-04-28T12:33:00.813 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-28T12:33:00.814 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.815 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.827 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.828 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.871 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.064) 0:02:12.633 ********* 2020-04-28T12:33:00.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.919 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:00 +0000 (0:00:00.045) 0:02:12.679 ********* 2020-04-28T12:33:00.924 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-28T12:33:00.924 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.926 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.938 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.939 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:00.951 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.050 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.133) 0:02:12.812 ********* 2020-04-28T12:33:01.057 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi066.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.059 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.098 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.048) 0:02:12.860 ********* 2020-04-28T12:33:01.104 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:33:01.105 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.154 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.055) 0:02:12.916 ********* 2020-04-28T12:33:01.161 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-04-28T12:33:01.163 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.164 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.175 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.176 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.220 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.066) 0:02:12.983 ********* 2020-04-28T12:33:01.228 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-28T12:33:01.229 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.269 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.048) 0:02:13.031 ********* 2020-04-28T12:33:01.275 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:33:01.275 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.320 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.050) 0:02:13.082 ********* 2020-04-28T12:33:01.327 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-28T12:33:01.327 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.372 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.051) 0:02:13.134 ********* 2020-04-28T12:33:01.378 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-28T12:33:01.380 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.422 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.050) 0:02:13.185 ********* 2020-04-28T12:33:01.424 INFO:teuthology.task.ansible.out: 2020-04-28T12:33:01.432 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:33:01.434 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.474 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.052) 0:02:13.237 ********* 2020-04-28T12:33:01.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-04-28T12:33:01.481 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.524 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.049) 0:02:13.286 ********* 2020-04-28T12:33:01.529 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-28T12:33:01.531 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.571 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.047) 0:02:13.334 ********* 2020-04-28T12:33:01.578 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:33:01.579 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.620 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.045) 0:02:13.380 ********* 2020-04-28T12:33:01.624 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:33:01.625 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.666 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.048) 0:02:13.428 ********* 2020-04-28T12:33:01.672 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-28T12:33:01.672 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.716 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.049) 0:02:13.478 ********* 2020-04-28T12:33:01.722 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-28T12:33:01.725 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.761 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.045) 0:02:13.523 ********* 2020-04-28T12:33:01.767 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:33:01.768 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.811 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.049) 0:02:13.573 ********* 2020-04-28T12:33:01.816 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:33:01.817 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.856 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.045) 0:02:13.618 ********* 2020-04-28T12:33:01.867 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.906 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.050) 0:02:13.669 ********* 2020-04-28T12:33:01.933 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:33:01.934 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:33:01.972 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:33:01 +0000 (0:00:00.065) 0:02:13.735 ********* 2020-04-28T12:33:02.082 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:33:02.084 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004769", "end": "2020-04-28 12:33:02.048686", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:33:02.043917", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:33:02.206 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005501", "end": "2020-04-28 12:33:02.170913", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:33:02.165412", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:33:02.271 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003017", "end": "2020-04-28 12:33:02.232509", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:33:02.229492", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:33:03.234 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003201", "end": "2020-04-28 12:33:02.370102", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:33:02.366901", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi197.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002841", "end": "2020-04-28 12:33:02.429753", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:33:02.426912", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} ok: [smithi066.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002989", "end": "2020-04-28 12:33:02.580132", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:33:02.577143", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} ok: [smithi197.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.039277", "end": "2020-04-28 12:33:02.682179", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:33:02.642902", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Tuesday 28 April 2020 12:33:02 +0000 (0:00:00.791) 0:02:14.527 ********* TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Tuesday 28 April 2020 2020-04-28T12:33:03.235 INFO:teuthology.task.ansible.out:12:33:02 +0000 (0:00:00.086) 0:02:14.613 ********* TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi066.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025173", "end": "2020-04-28 12:33:02.808378", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:33:02.783205", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Tuesday 28 April 2020 12:33:02 +0000 (0:00:00.052) 0:02:14.665 ********* TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Tuesday 28 April 2020 12:33:02 +0000 (0:00:00.071) 0:02:14.737 ********* TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:33:03.291 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-04-28T12:33:03.293 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-04-28T12:33:03.295 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-04-28T12:33:03.297 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi066.front.sepia.ceph.com : ok=113 changed=31 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi197.front.sepia.ceph.com : ok=113 changed=32 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Tuesday 28 April 2020 12:33:03 +0000 (0:00:00.321) 0:02:15.058 ********* =============================================================================== 2020-04-28T12:33:03.297 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 16.44s common : nrpe - Load SELinux policy package ---------------------------- 15.72s testnode : Zap all non-root disks --------------------------------------- 6.93s testnode : Install packages --------------------------------------------- 6.02s testnode : Base group workaround for BZ1782899 -------------------------- 3.57s testnode : Ensure ceph dependency packages are not present. ------------- 1.62s 2020-04-28T12:33:03.297 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 1.59s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.37s testnode : Install packages via pip ------------------------------------- 1.25s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.24s testnode : Create logical volume(s) ------------------------------------- 1.22s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.15s common : Install Kerberos Packages (RedHat) ----------------------------- 1.10s ansible-managed : Add authorized keys for the ansible user. ------------- 1.01s common : Set the hardware clock ----------------------------------------- 1.01s users : Create all admin users with sudo access. ------------------------ 0.94s common : Configure local epel mirrorlists ------------------------------- 0.92s ansible-managed : Create the cephlab_sudo sudoers.d file. ---------- 2020-04-28T12:33:03.299 INFO:teuthology.task.ansible.out:----- 0.90s common : nrpe - Install SELinux dependencies ---------------------------- 0.89s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.88s 2020-04-28T12:33:03.586 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi197.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com')] 2020-04-28T12:33:03.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:33:03.589 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi197.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:03.661 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:03.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:33:03.752 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi066.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:33:03.826 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:03.910 INFO:teuthology.run_tasks:Running task clock... 2020-04-28T12:33:03.924 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-28T12:33:03.924 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:03.938 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:33:03.939 INFO:teuthology.orchestra.run.smithi197:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:33:04.047 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:33:04.048 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:33:04.082 INFO:teuthology.orchestra.run.smithi197.stderr:sudo: ntpd: command not found 2020-04-28T12:33:04.099 INFO:teuthology.orchestra.run.smithi197.stdout:506 Cannot talk to daemon 2020-04-28T12:33:04.115 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:33:04.143 INFO:teuthology.orchestra.run.smithi197.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:33:04.208 INFO:teuthology.orchestra.run.smithi197.stderr:bash: ntpq: command not found 2020-04-28T12:33:04.217 INFO:teuthology.orchestra.run.smithi197.stdout:210 Number of sources = 4 2020-04-28T12:33:04.217 INFO:teuthology.orchestra.run.smithi197.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:33:04.218 INFO:teuthology.orchestra.run.smithi197.stdout:=============================================================================== 2020-04-28T12:33:04.218 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.218 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.218 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.218 INFO:teuthology.orchestra.run.smithi197.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.219 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:04.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:33:04.236 INFO:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:33:04.348 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:33:04.348 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:33:04.416 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2020-04-28T12:33:04.449 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:33:04.451 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2020-04-28T12:33:04.466 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:33:04.531 INFO:teuthology.orchestra.run.smithi066.stderr:bash: ntpq: command not found 2020-04-28T12:33:04.575 INFO:teuthology.orchestra.run.smithi066.stdout:210 Number of sources = 4 2020-04-28T12:33:04.575 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:33:04.575 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2020-04-28T12:33:04.575 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.576 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.576 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.576 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:33:04.576 INFO:teuthology.run_tasks:Running task install... 2020-04-28T12:33:04.587 DEBUG:teuthology.task.install:project ceph 2020-04-28T12:33:04.587 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}} 2020-04-28T12:33:04.587 DEBUG:teuthology.task.install:config {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:33:04.587 INFO:teuthology.task.install:Using flavor: basic 2020-04-28T12:33:04.594 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-28T12:33:04.594 INFO:teuthology.task.install:extra packages: [] 2020-04-28T12:33:04.594 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:04.609 INFO:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2020-04-28T12:33:04.685 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS 2020-04-28T12:33:04.686 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:33:04.686 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:04.687 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:33:04.687 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:04.701 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-04-28T12:33:04.739 INFO:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2020-04-28T12:33:04.781 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS 2020-04-28T12:33:04.782 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:33:04.782 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:33:04.783 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:04.826 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS 2020-04-28T12:33:04.826 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:33:04.827 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:33:04.847 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-04-28T12:33:04.926 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS 2020-04-28T12:33:04.927 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:33:04.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:33:05.066 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:33:05.066 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:33:05.158 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:33:05.158 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:33:05.403 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:33:05.404 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:05.418 INFO:teuthology.orchestra.run.smithi197:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:33:05.493 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:33:05.493 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:05.503 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:33:05.504 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:05.508 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:33:05.557 INFO:teuthology.orchestra.run.smithi197:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:33:05.594 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:33:05.595 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:05.627 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:05.650 INFO:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:33:05.681 INFO:teuthology.orchestra.run.smithi197:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:33:05.724 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:05.763 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:05.780 INFO:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:33:05.815 INFO:teuthology.orchestra.run.smithi197:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:33:05.871 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:05.883 INFO:teuthology.orchestra.run.smithi197.stdout:check_obsoletes = 1 2020-04-28T12:33:05.885 INFO:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:33:05.886 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:05.939 INFO:teuthology.orchestra.run.smithi197:> sudo yum clean all 2020-04-28T12:33:05.956 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2020-04-28T12:33:05.957 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:06.012 INFO:teuthology.orchestra.run.smithi066:> sudo yum clean all 2020-04-28T12:33:06.214 INFO:teuthology.orchestra.run.smithi197.stdout:50 files removed 2020-04-28T12:33:06.243 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:06.256 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-radosgw 2020-04-28T12:33:06.305 INFO:teuthology.orchestra.run.smithi066.stdout:50 files removed 2020-04-28T12:33:06.334 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:06.348 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw 2020-04-28T12:33:07.005 INFO:teuthology.orchestra.run.smithi197.stdout:ceph packages for x86_64 183 kB/s | 69 kB 00:00 2020-04-28T12:33:07.127 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 182 kB/s | 69 kB 00:00 2020-04-28T12:33:07.343 INFO:teuthology.orchestra.run.smithi197.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-28T12:33:07.469 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-28T12:33:07.671 INFO:teuthology.orchestra.run.smithi197.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-28T12:33:07.800 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-28T12:33:07.831 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS-8 - AppStream 50 MB/s | 7.0 MB 00:00 2020-04-28T12:33:07.964 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-8 - AppStream 49 MB/s | 7.0 MB 00:00 2020-04-28T12:33:09.030 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-04-28T12:33:09.261 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-04-28T12:33:09.478 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS-8 - Extras 88 kB/s | 5.5 kB 00:00 2020-04-28T12:33:09.628 INFO:teuthology.orchestra.run.smithi197.stdout:Copr repo for ceph-el8 owned by ktdreyer 498 kB/s | 47 kB 00:00 2020-04-28T12:33:09.719 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-04-28T12:33:09.863 INFO:teuthology.orchestra.run.smithi066.stdout:Copr repo for ceph-el8 owned by ktdreyer 505 kB/s | 47 kB 00:00 2020-04-28T12:33:09.941 INFO:teuthology.orchestra.run.smithi197.stdout:Extra Packages for Enterprise Linux 24 MB/s | 6.4 MB 00:00 2020-04-28T12:33:10.232 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 21 MB/s | 6.4 MB 00:00 2020-04-28T12:33:11.341 INFO:teuthology.orchestra.run.smithi197.stdout:lab-extras 4.4 MB/s | 20 kB 00:00 2020-04-28T12:33:11.660 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 3.9 MB/s | 20 kB 00:00 2020-04-28T12:33:12.352 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:33:12.355 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:12.355 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2020-04-28T12:33:12.355 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:12.355 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:33:12.355 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:33:12.356 INFO:teuthology.orchestra.run.smithi197.stdout:Upgrading: 2020-04-28T12:33:12.356 INFO:teuthology.orchestra.run.smithi197.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:33:12.356 INFO:teuthology.orchestra.run.smithi197.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:33:12.356 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:33:12.356 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:33:12.357 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:33:12.357 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:33:12.357 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:33:12.357 INFO:teuthology.orchestra.run.smithi197.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:33:12.357 INFO:teuthology.orchestra.run.smithi197.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:33:12.357 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-argparse 2020-04-28T12:33:12.358 INFO:teuthology.orchestra.run.smithi197.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:33:12.358 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:33:12.358 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:33:12.358 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:33:12.358 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:33:12.359 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:33:12.359 INFO:teuthology.orchestra.run.smithi197.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:33:12.359 INFO:teuthology.orchestra.run.smithi197.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:33:12.359 INFO:teuthology.orchestra.run.smithi197.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:33:12.359 INFO:teuthology.orchestra.run.smithi197.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:33:12.359 INFO:teuthology.orchestra.run.smithi197.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:33:12.360 INFO:teuthology.orchestra.run.smithi197.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:33:12.360 INFO:teuthology.orchestra.run.smithi197.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:33:12.360 INFO:teuthology.orchestra.run.smithi197.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:33:12.360 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:12.360 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:33:12.361 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:12.361 INFO:teuthology.orchestra.run.smithi197.stdout:Install 21 Packages 2020-04-28T12:33:12.361 INFO:teuthology.orchestra.run.smithi197.stdout:Upgrade 2 Packages 2020-04-28T12:33:12.361 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:12.362 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 51 M 2020-04-28T12:33:12.362 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:33:12.735 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:33:12.738 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:33:12.738 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2020-04-28T12:33:12.738 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:33:12.739 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:33:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:33:12.739 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2020-04-28T12:33:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:33:12.739 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:33:12.739 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:33:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:33:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:33:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:33:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:33:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:33:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:33:12.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:33:12.741 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:33:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:33:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:33:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:33:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:33:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:33:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:33:12.742 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:12.743 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:33:12.743 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:33:12.743 INFO:teuthology.orchestra.run.smithi066.stdout:Install 21 Packages 2020-04-28T12:33:12.743 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 2 Packages 2020-04-28T12:33:12.743 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:12.744 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 51 M 2020-04-28T12:33:12.760 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:33:13.205 INFO:teuthology.orchestra.run.smithi197.stdout:(1/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x8 6.5 MB/s | 5.5 MB 00:00 2020-04-28T12:33:13.256 INFO:teuthology.orchestra.run.smithi197.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 480 kB/s | 25 kB 00:00 2020-04-28T12:33:13.326 INFO:teuthology.orchestra.run.smithi197.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 7.1 MB/s | 508 kB 00:00 2020-04-28T12:33:13.394 INFO:teuthology.orchestra.run.smithi197.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 5.5 MB/s | 377 kB 00:00 2020-04-28T12:33:13.689 INFO:teuthology.orchestra.run.smithi197.stdout:(5/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el8 7.4 MB/s | 9.8 MB 00:01 2020-04-28T12:33:13.758 INFO:teuthology.orchestra.run.smithi197.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 576 kB/s | 40 kB 00:00 2020-04-28T12:33:13.827 INFO:teuthology.orchestra.run.smithi197.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 921 kB/s | 64 kB 00:00 2020-04-28T12:33:13.903 INFO:teuthology.orchestra.run.smithi197.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 2.1 MB/s | 162 kB 00:00 2020-04-28T12:33:13.995 INFO:teuthology.orchestra.run.smithi197.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 3.8 MB/s | 352 kB 00:00 2020-04-28T12:33:14.085 INFO:teuthology.orchestra.run.smithi197.stdout:(10/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 3.3 MB/s | 309 kB 00:00 2020-04-28T12:33:14.106 INFO:teuthology.orchestra.run.smithi197.stdout:(11/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86 8.8 MB/s | 6.2 MB 00:00 2020-04-28T12:33:14.140 INFO:teuthology.orchestra.run.smithi197.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2020-04-28T12:33:14.143 INFO:teuthology.orchestra.run.smithi197.stdout:(13/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 1.9 MB/s | 113 kB 00:00 2020-04-28T12:33:14.145 INFO:teuthology.orchestra.run.smithi197.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 58 MB/s | 259 kB 00:00 2020-04-28T12:33:14.151 INFO:teuthology.orchestra.run.smithi197.stdout:(15/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 27 MB/s | 47 kB 00:00 2020-04-28T12:33:14.172 INFO:teuthology.orchestra.run.smithi197.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 1.5 MB/s | 44 kB 00:00 2020-04-28T12:33:14.244 INFO:teuthology.orchestra.run.smithi197.stdout:(17/23): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-28T12:33:14.249 INFO:teuthology.orchestra.run.smithi197.stdout:(18/23): leveldb-1.22-1.el8.x86_64.rpm 2.3 MB/s | 181 kB 00:00 2020-04-28T12:33:14.263 INFO:teuthology.orchestra.run.smithi197.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 3.6 MB/s | 59 kB 00:00 2020-04-28T12:33:14.265 INFO:teuthology.orchestra.run.smithi197.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-04-28T12:33:14.531 INFO:teuthology.orchestra.run.smithi197.stdout:(21/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 13 MB/s | 3.6 MB 00:00 2020-04-28T12:33:14.608 INFO:teuthology.orchestra.run.smithi197.stdout:(22/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 5.6 MB/s | 1.9 MB 00:00 2020-04-28T12:33:15.006 INFO:teuthology.orchestra.run.smithi197.stdout:(23/23): ceph-common-15.2.1-136.ga8c125c7d7.el8 7.8 MB/s | 21 MB 00:02 2020-04-28T12:33:15.008 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:33:15.008 INFO:teuthology.orchestra.run.smithi197.stdout:Total 19 MB/s | 51 MB 00:02 2020-04-28T12:33:15.014 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:33:15.049 INFO:teuthology.orchestra.run.smithi066.stdout:(1/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x8 2.4 MB/s | 5.5 MB 00:02 2020-04-28T12:33:15.057 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:33:15.057 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:33:15.097 INFO:teuthology.orchestra.run.smithi066.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 520 kB/s | 25 kB 00:00 2020-04-28T12:33:15.177 INFO:teuthology.orchestra.run.smithi066.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 6.2 MB/s | 508 kB 00:00 2020-04-28T12:33:15.251 INFO:teuthology.orchestra.run.smithi066.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 5.0 MB/s | 377 kB 00:00 2020-04-28T12:33:15.404 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:33:15.404 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:33:15.558 INFO:teuthology.orchestra.run.smithi066.stdout:(5/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el8 3.5 MB/s | 9.8 MB 00:02 2020-04-28T12:33:15.622 INFO:teuthology.orchestra.run.smithi066.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 624 kB/s | 40 kB 00:00 2020-04-28T12:33:15.675 INFO:teuthology.orchestra.run.smithi066.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 1.3 MB/s | 64 kB 00:00 2020-04-28T12:33:15.740 INFO:teuthology.orchestra.run.smithi066.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 2.2 MB/s | 162 kB 00:00 2020-04-28T12:33:15.801 INFO:teuthology.orchestra.run.smithi066.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 5.6 MB/s | 352 kB 00:00 2020-04-28T12:33:15.864 INFO:teuthology.orchestra.run.smithi066.stdout:(10/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 4.8 MB/s | 309 kB 00:00 2020-04-28T12:33:15.919 INFO:teuthology.orchestra.run.smithi066.stdout:(11/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 2.0 MB/s | 113 kB 00:00 2020-04-28T12:33:15.966 INFO:teuthology.orchestra.run.smithi066.stdout:(12/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86 8.7 MB/s | 6.2 MB 00:00 2020-04-28T12:33:15.975 INFO:teuthology.orchestra.run.smithi066.stdout:(13/23): librdkafka-0.11.4-1.el8.x86_64.rpm 6.2 MB/s | 353 kB 00:00 2020-04-28T12:33:15.976 INFO:teuthology.orchestra.run.smithi066.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 30 MB/s | 44 kB 00:00 2020-04-28T12:33:15.978 INFO:teuthology.orchestra.run.smithi066.stdout:(15/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 29 MB/s | 47 kB 00:00 2020-04-28T12:33:16.026 INFO:teuthology.orchestra.run.smithi066.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2020-04-28T12:33:16.072 INFO:teuthology.orchestra.run.smithi066.stdout:(17/23): gperftools-libs-2.7-6.el8.x86_64.rpm 3.3 MB/s | 315 kB 00:00 2020-04-28T12:33:16.088 INFO:teuthology.orchestra.run.smithi066.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-04-28T12:33:16.104 INFO:teuthology.orchestra.run.smithi066.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-04-28T12:33:16.119 INFO:teuthology.orchestra.run.smithi066.stdout:(20/23): leveldb-1.22-1.el8.x86_64.rpm 1.9 MB/s | 181 kB 00:00 2020-04-28T12:33:16.381 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:33:16.565 INFO:teuthology.orchestra.run.smithi066.stdout:(21/23): ceph-common-15.2.1-136.ga8c125c7d7.el8 5.4 MB/s | 21 MB 00:03 2020-04-28T12:33:16.575 INFO:teuthology.orchestra.run.smithi066.stdout:(22/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 4.2 MB/s | 1.9 MB 00:00 2020-04-28T12:33:16.587 INFO:teuthology.orchestra.run.smithi066.stdout:(23/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 7.4 MB/s | 3.6 MB 00:00 2020-04-28T12:33:16.590 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:33:16.591 INFO:teuthology.orchestra.run.smithi066.stdout:Total 13 MB/s | 51 MB 00:03 2020-04-28T12:33:16.597 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:33:16.604 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:33:16.644 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:33:16.645 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:33:16.783 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:33:17.003 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:33:17.004 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:33:17.181 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:33:17.358 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:33:17.436 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:33:17.633 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:33:17.774 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:33:18.002 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:33:18.182 INFO:teuthology.orchestra.run.smithi197.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:33:18.185 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:33:18.233 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:33:18.384 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:33:18.390 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:33:18.583 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:33:18.583 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:33:18.999 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:33:19.175 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:33:19.183 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:33:19.280 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:33:19.332 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:33:19.410 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:33:19.495 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:33:19.612 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:33:19.633 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:33:19.741 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:33:19.895 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:33:19.919 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:33:20.091 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:33:20.137 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:33:20.144 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:33:20.326 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:33:20.361 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:33:20.458 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:33:20.524 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:33:20.594 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:33:20.801 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:33:20.973 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:33:21.142 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:33:21.146 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:33:21.257 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:33:21.283 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:33:21.398 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:33:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:33:21.693 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:33:22.004 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:33:22.165 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:33:22.393 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:33:22.558 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:33:22.631 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:33:22.852 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:33:23.017 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:33:23.182 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:33:23.358 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:33:24.825 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:33:25.007 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:33:25.674 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:33:25.981 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:33:26.062 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:33:26.231 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:33:27.146 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:33:27.316 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:33:28.032 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:33:28.435 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:33:28.539 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:33:28.682 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:33:42.914 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:33:42.914 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /sys 2020-04-28T12:33:42.914 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /proc 2020-04-28T12:33:42.914 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /dev 2020-04-28T12:33:42.914 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /run 2020-04-28T12:33:42.914 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /mnt 2020-04-28T12:33:42.915 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /var/tmp 2020-04-28T12:33:42.915 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /home 2020-04-28T12:33:42.915 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /tmp 2020-04-28T12:33:42.915 INFO:teuthology.orchestra.run.smithi197.stdout:skipping the directory /dev 2020-04-28T12:33:42.915 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:43.970 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:33:44.042 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:33:44.042 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:33:44.247 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:33:44.247 INFO:teuthology.orchestra.run.smithi197.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:33:44.869 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:33:44.869 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:33:44.869 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:33:44.869 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:33:44.870 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:33:44.870 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:33:44.870 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:33:44.870 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:33:44.870 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:33:44.870 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:33:44.871 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:33:44.871 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:33:44.871 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:33:44.871 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:33:44.871 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:33:44.871 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:33:44.871 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:33:44.872 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:33:44.872 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:33:44.872 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:33:44.872 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:33:44.872 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:33:44.872 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:33:44.872 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:33:44.873 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:33:45.524 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:33:45.525 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:45.525 INFO:teuthology.orchestra.run.smithi197.stdout:Upgraded: 2020-04-28T12:33:45.525 INFO:teuthology.orchestra.run.smithi197.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.525 INFO:teuthology.orchestra.run.smithi197.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.525 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:45.525 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:33:45.526 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.526 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.526 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.526 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.526 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.526 INFO:teuthology.orchestra.run.smithi197.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.526 INFO:teuthology.orchestra.run.smithi197.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.527 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:45.527 INFO:teuthology.orchestra.run.smithi197.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:33:45.528 INFO:teuthology.orchestra.run.smithi197.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:33:45.528 INFO:teuthology.orchestra.run.smithi197.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:33:45.528 INFO:teuthology.orchestra.run.smithi197.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:33:45.528 INFO:teuthology.orchestra.run.smithi197.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:33:45.528 INFO:teuthology.orchestra.run.smithi197.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:33:45.528 INFO:teuthology.orchestra.run.smithi197.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:33:45.528 INFO:teuthology.orchestra.run.smithi197.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:33:45.529 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:45.529 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:33:45.578 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:33:45.578 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2020-04-28T12:33:45.578 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2020-04-28T12:33:45.578 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /dev 2020-04-28T12:33:45.579 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /run 2020-04-28T12:33:45.579 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2020-04-28T12:33:45.579 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2020-04-28T12:33:45.579 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2020-04-28T12:33:45.579 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2020-04-28T12:33:45.579 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /dev 2020-04-28T12:33:45.579 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:46.245 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:46.260 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-test 2020-04-28T12:33:46.709 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:00:35 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:33:46.722 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:33:46.813 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:33:46.813 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:33:47.007 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:33:47.007 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:33:47.062 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:33:47.063 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:47.063 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2020-04-28T12:33:47.063 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:47.063 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:33:47.063 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:33:47.064 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:33:47.064 INFO:teuthology.orchestra.run.smithi197.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:33:47.064 INFO:teuthology.orchestra.run.smithi197.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:33:47.064 INFO:teuthology.orchestra.run.smithi197.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:33:47.064 INFO:teuthology.orchestra.run.smithi197.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:33:47.064 INFO:teuthology.orchestra.run.smithi197.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:33:47.065 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:47.065 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:33:47.065 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:47.065 INFO:teuthology.orchestra.run.smithi197.stdout:Install 6 Packages 2020-04-28T12:33:47.065 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:47.066 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 43 M 2020-04-28T12:33:47.066 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 185 M 2020-04-28T12:33:47.066 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:33:47.098 INFO:teuthology.orchestra.run.smithi197.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2020-04-28T12:33:47.104 INFO:teuthology.orchestra.run.smithi197.stdout:(2/6): socat-1.7.3.2-6.el8.x86_64.rpm 52 MB/s | 298 kB 00:00 2020-04-28T12:33:47.105 INFO:teuthology.orchestra.run.smithi197.stdout:(3/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.6 MB/s | 188 kB 00:00 2020-04-28T12:33:47.109 INFO:teuthology.orchestra.run.smithi197.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 61 MB/s | 249 kB 00:00 2020-04-28T12:33:47.167 INFO:teuthology.orchestra.run.smithi197.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-04-28T12:33:47.576 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:33:47.576 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:33:47.577 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:33:47.577 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:33:47.577 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:33:47.577 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:33:47.577 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:33:47.577 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:33:47.578 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:33:47.578 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:33:47.578 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:33:47.578 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:33:47.578 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:33:47.578 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:33:47.578 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:33:47.579 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:33:47.579 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:33:47.579 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:33:47.579 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:33:47.579 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:33:47.579 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:33:47.579 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:33:47.580 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:33:47.580 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:33:47.580 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:33:48.197 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:33:48.198 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:48.198 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2020-04-28T12:33:48.198 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.198 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.198 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:48.198 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:33:48.199 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.199 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.199 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.199 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.199 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.199 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.200 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.200 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.200 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.200 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.200 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.200 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.200 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:33:48.201 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:33:48.201 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:33:48.201 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:33:48.201 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:33:48.201 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:33:48.201 INFO:teuthology.orchestra.run.smithi066.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:33:48.201 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:33:48.202 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:33:48.202 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:48.202 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:33:48.562 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:33:48.577 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-test 2020-04-28T12:33:49.046 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:38 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:33:49.415 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:33:49.417 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:33:49.417 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2020-04-28T12:33:49.417 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:33:49.418 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:33:49.418 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:33:49.418 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:33:49.418 INFO:teuthology.orchestra.run.smithi066.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:33:49.418 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:33:49.418 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:33:49.419 INFO:teuthology.orchestra.run.smithi066.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:33:49.419 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:33:49.419 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:49.419 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:33:49.419 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:33:49.419 INFO:teuthology.orchestra.run.smithi066.stdout:Install 6 Packages 2020-04-28T12:33:49.420 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:33:49.420 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 43 M 2020-04-28T12:33:49.420 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 185 M 2020-04-28T12:33:49.420 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:33:49.451 INFO:teuthology.orchestra.run.smithi066.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.9 MB/s | 161 kB 00:00 2020-04-28T12:33:49.457 INFO:teuthology.orchestra.run.smithi066.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.8 MB/s | 188 kB 00:00 2020-04-28T12:33:49.458 INFO:teuthology.orchestra.run.smithi066.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 42 MB/s | 298 kB 00:00 2020-04-28T12:33:49.461 INFO:teuthology.orchestra.run.smithi066.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 62 MB/s | 249 kB 00:00 2020-04-28T12:33:49.522 INFO:teuthology.orchestra.run.smithi066.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-04-28T12:33:49.982 INFO:teuthology.orchestra.run.smithi197.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 14 MB/s | 42 MB 00:02 2020-04-28T12:33:49.984 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:33:49.985 INFO:teuthology.orchestra.run.smithi197.stdout:Total 15 MB/s | 43 MB 00:02 2020-04-28T12:33:49.990 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:33:50.011 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:33:50.012 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:33:50.279 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:33:50.279 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:33:50.735 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:33:50.963 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:33:51.160 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:33:51.915 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:33:52.086 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:33:52.169 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:33:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 10 MB/s | 42 MB 00:04 2020-04-28T12:33:53.515 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:33:53.515 INFO:teuthology.orchestra.run.smithi066.stdout:Total 10 MB/s | 43 MB 00:04 2020-04-28T12:33:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:33:53.547 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:33:53.547 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:33:53.826 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:33:53.827 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:33:54.440 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:33:54.594 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:33:54.783 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:33:54.938 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:33:55.108 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:33:55.183 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:33:56.274 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:33:56.482 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:33:56.682 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:33:56.682 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:33:56.682 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:33:56.682 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:33:56.682 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:33:56.683 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:33:57.002 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:33:57.002 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:57.002 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:33:57.002 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:33:57.002 INFO:teuthology.orchestra.run.smithi197.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:33:57.003 INFO:teuthology.orchestra.run.smithi197.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:33:57.003 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:57.003 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:33:57.289 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:33:57.303 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph 2020-04-28T12:33:57.770 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:00:46 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:33:58.634 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:33:58.637 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:58.638 INFO:teuthology.orchestra.run.smithi197.stdout: Package ArchVersion Repository Size 2020-04-28T12:33:58.638 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:58.638 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:33:58.638 INFO:teuthology.orchestra.run.smithi197.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:33:58.638 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:33:58.638 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:33:58.638 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:33:58.639 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:33:58.639 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:33:58.639 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:33:58.639 INFO:teuthology.orchestra.run.smithi197.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:33:58.639 INFO:teuthology.orchestra.run.smithi197.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:33:58.639 INFO:teuthology.orchestra.run.smithi197.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:33:58.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:33:58.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:33:58.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:33:58.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:33:58.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:33:58.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:33:58.640 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:33:58.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:33:58.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:33:58.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:33:58.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:33:58.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:33:58.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:33:58.641 INFO:teuthology.orchestra.run.smithi197.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:33:58.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:33:58.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:33:58.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:33:58.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:33:58.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:33:58.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:33:58.642 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout:Installing weak dependencies: 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout:Install 32 Packages 2020-04-28T12:33:58.643 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:33:58.644 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 29 M 2020-04-28T12:33:58.644 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 103 M 2020-04-28T12:33:58.644 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:33:58.801 INFO:teuthology.orchestra.run.smithi197.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 41 kB/s | 6.4 kB 00:00 2020-04-28T12:33:59.081 INFO:teuthology.orchestra.run.smithi197.stdout:(2/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 4.6 MB/s | 2.0 MB 00:00 2020-04-28T12:33:59.098 INFO:teuthology.orchestra.run.smithi197.stdout:(3/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 3.1 MB/s | 1.4 MB 00:00 2020-04-28T12:33:59.176 INFO:teuthology.orchestra.run.smithi197.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 2.1 MB/s | 164 kB 00:00 2020-04-28T12:33:59.209 INFO:teuthology.orchestra.run.smithi197.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 6.3 MB/s | 214 kB 00:00 2020-04-28T12:33:59.228 INFO:teuthology.orchestra.run.smithi197.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 78 MB/s | 1.5 MB 00:00 2020-04-28T12:33:59.231 INFO:teuthology.orchestra.run.smithi197.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 55 MB/s | 157 kB 00:00 2020-04-28T12:33:59.232 INFO:teuthology.orchestra.run.smithi197.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 30 MB/s | 39 kB 00:00 2020-04-28T12:33:59.234 INFO:teuthology.orchestra.run.smithi197.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 36 MB/s | 54 kB 00:00 2020-04-28T12:33:59.235 INFO:teuthology.orchestra.run.smithi197.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 25 MB/s | 27 kB 00:00 2020-04-28T12:33:59.241 INFO:teuthology.orchestra.run.smithi197.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 76 MB/s | 457 kB 00:00 2020-04-28T12:33:59.298 INFO:teuthology.orchestra.run.smithi197.stdout:(12/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.5 MB/s | 145 kB 00:00 2020-04-28T12:33:59.319 INFO:teuthology.orchestra.run.smithi197.stdout:(13/32): python3-cherrypy-18.4.0-1.el8.noarch.r 18 MB/s | 385 kB 00:00 2020-04-28T12:33:59.327 INFO:teuthology.orchestra.run.smithi197.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.5 MB/s | 11 kB 00:00 2020-04-28T12:33:59.336 INFO:teuthology.orchestra.run.smithi197.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 2.2 MB/s | 18 kB 00:00 2020-04-28T12:33:59.344 INFO:teuthology.orchestra.run.smithi197.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 5.8 MB/s | 49 kB 00:00 2020-04-28T12:33:59.353 INFO:teuthology.orchestra.run.smithi197.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 6.9 MB/s | 59 kB 00:00 2020-04-28T12:33:59.365 INFO:teuthology.orchestra.run.smithi197.stdout:(18/32): python3-pecan-1.3.2-9.el8.noarch.rpm 24 MB/s | 283 kB 00:00 2020-04-28T12:33:59.373 INFO:teuthology.orchestra.run.smithi197.stdout:(19/32): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-28T12:33:59.381 INFO:teuthology.orchestra.run.smithi197.stdout:(20/32): python3-simplegeneric-0.8.1-17.el8.noa 2.3 MB/s | 19 kB 00:00 2020-04-28T12:33:59.390 INFO:teuthology.orchestra.run.smithi197.stdout:(21/32): python3-singledispatch-3.4.0.3-18.el8. 2.9 MB/s | 24 kB 00:00 2020-04-28T12:33:59.398 INFO:teuthology.orchestra.run.smithi197.stdout:(22/32): python3-tempora-1.14.1-5.el8.noarch.rp 3.5 MB/s | 30 kB 00:00 2020-04-28T12:33:59.406 INFO:teuthology.orchestra.run.smithi197.stdout:(23/32): python3-trustme-0.5.2-4.el8.noarch.rpm 3.3 MB/s | 27 kB 00:00 2020-04-28T12:33:59.415 INFO:teuthology.orchestra.run.smithi197.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.7 MB/s | 23 kB 00:00 2020-04-28T12:33:59.477 INFO:teuthology.orchestra.run.smithi197.stdout:(25/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 710 kB/s | 44 kB 00:00 2020-04-28T12:33:59.495 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:33:59.523 INFO:teuthology.orchestra.run.smithi197.stdout:(26/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.9 MB/s | 185 kB 00:00 2020-04-28T12:33:59.538 INFO:teuthology.orchestra.run.smithi197.stdout:(27/32): python3-cssselect-0.9.2-10.el8.noarch. 2.5 MB/s | 40 kB 00:00 2020-04-28T12:33:59.571 INFO:teuthology.orchestra.run.smithi197.stdout:(28/32): python3-waitress-1.2.1-2.el8.1.noarch. 7.6 MB/s | 241 kB 00:00 2020-04-28T12:33:59.595 INFO:teuthology.orchestra.run.smithi197.stdout:(29/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 5.5 MB/s | 4.4 MB 00:00 2020-04-28T12:33:59.597 INFO:teuthology.orchestra.run.smithi197.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 9.1 MB/s | 251 kB 00:00 2020-04-28T12:33:59.656 INFO:teuthology.orchestra.run.smithi197.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2020-04-28T12:33:59.675 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:33:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:33:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:33:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:33:59.906 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:33:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:33:59.907 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:33:59.939 INFO:teuthology.orchestra.run.smithi197.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 19 MB/s | 17 MB 00:00 2020-04-28T12:33:59.942 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:33:59.942 INFO:teuthology.orchestra.run.smithi197.stdout:Total 22 MB/s | 29 MB 00:01 2020-04-28T12:33:59.949 INFO:teuthology.orchestra.run.smithi197.stderr:warning: /var/cache/dnf/copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8-0161c520b1c9fbf7/packages/python3-cheroot-8.2.1-1.el8.noarch.rpm: Header V3 RSA/SHA1 Signature, key ID 2a8a41ec: NOKEY 2020-04-28T12:33:59.991 INFO:teuthology.orchestra.run.smithi197.stdout:Copr repo for ceph-el8 owned by ktdreyer 24 kB/s | 1.0 kB 00:00 2020-04-28T12:34:00.107 INFO:teuthology.orchestra.run.smithi197.stderr:Importing GPG key 0x2A8A41EC: 2020-04-28T12:34:00.108 INFO:teuthology.orchestra.run.smithi197.stderr: Userid : "ktdreyer_ceph-el8 (None) " 2020-04-28T12:34:00.108 INFO:teuthology.orchestra.run.smithi197.stderr: Fingerprint: 64D3 346F FD63 5D2D B5D0 5873 1014 BDBE 2A8A 41EC 2020-04-28T12:34:00.108 INFO:teuthology.orchestra.run.smithi197.stderr: From : https://download.copr.fedorainfracloud.org/results/ktdreyer/ceph-el8/pubkey.gpg 2020-04-28T12:34:00.201 INFO:teuthology.orchestra.run.smithi197.stdout:Key imported successfully 2020-04-28T12:34:00.213 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:34:00.213 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:00.213 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:34:00.213 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:34:00.213 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:34:00.213 INFO:teuthology.orchestra.run.smithi066.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:34:00.214 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:00.214 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:00.215 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:00.252 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:00.252 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:00.514 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:00.528 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph 2020-04-28T12:34:00.550 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:00.551 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:00.985 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:49 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:01.408 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:01.411 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:01.412 INFO:teuthology.orchestra.run.smithi066.stdout: Package ArchVersion Repository Size 2020-04-28T12:34:01.412 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:01.412 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:34:01.412 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:34:01.412 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:34:01.412 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:34:01.412 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:34:01.413 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:34:01.413 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:34:01.413 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:34:01.413 INFO:teuthology.orchestra.run.smithi066.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:34:01.413 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:34:01.413 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:34:01.414 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:34:01.414 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:34:01.414 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:34:01.414 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:34:01.414 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:34:01.414 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:34:01.415 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:34:01.415 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:34:01.415 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:34:01.415 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:34:01.415 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:34:01.415 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:34:01.415 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:34:01.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:34:01.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:34:01.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:34:01.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:34:01.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:34:01.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:34:01.417 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:34:01.417 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:34:01.417 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2020-04-28T12:34:01.417 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:34:01.417 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:34:01.418 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:01.418 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:34:01.418 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:01.418 INFO:teuthology.orchestra.run.smithi066.stdout:Install 32 Packages 2020-04-28T12:34:01.418 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:01.419 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 29 M 2020-04-28T12:34:01.419 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 103 M 2020-04-28T12:34:01.419 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:34:01.747 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:02.004 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:34:02.222 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:34:02.436 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:34:02.601 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:34:02.783 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:34:02.845 INFO:teuthology.orchestra.run.smithi066.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 4.5 kB/s | 6.4 kB 00:01 2020-04-28T12:34:03.000 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:34:03.174 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:34:03.321 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:34:03.528 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:34:03.704 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:34:03.856 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:34:04.090 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:34:04.364 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:34:04.603 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:34:04.822 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:34:05.038 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:34:05.376 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:34:05.681 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:34:05.873 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:34:06.086 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:34:06.264 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:34:06.528 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:34:06.796 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:34:07.055 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:34:07.425 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:34:07.756 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:34:08.047 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:(2/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 214 kB/s | 1.4 MB 00:06 2020-04-28T12:34:08.215 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:34:08.283 INFO:teuthology.orchestra.run.smithi066.stdout:(3/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 303 kB/s | 2.0 MB 00:06 2020-04-28T12:34:09.631 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:34:09.808 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:34:10.192 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:34:10.391 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:34:10.594 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:34:10.733 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:34:10.752 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:34:10.881 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:34:11.186 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:34:11.186 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:34:11.186 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:34:11.187 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:34:11.187 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:34:11.187 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:34:11.187 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:34:11.187 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:34:11.187 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:34:11.188 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:34:11.189 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:34:11.189 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:34:11.189 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:34:11.189 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:34:11.189 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:34:11.189 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:34:11.189 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:34:11.190 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:34:11.190 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:34:11.190 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:34:11.190 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:34:11.191 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:34:11.191 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:34:11.191 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:34:11.191 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:34:11.883 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:34:11.883 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:11.883 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:11.883 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:11.884 INFO:teuthology.orchestra.run.smithi197.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:34:11.884 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:34:11.884 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:11.884 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:11.884 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:11.884 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:11.884 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:11.885 INFO:teuthology.orchestra.run.smithi197.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:34:11.885 INFO:teuthology.orchestra.run.smithi197.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:34:11.885 INFO:teuthology.orchestra.run.smithi197.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:34:11.885 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:34:11.885 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:34:11.885 INFO:teuthology.orchestra.run.smithi197.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:34:11.885 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:34:11.886 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:34:11.886 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:34:11.886 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:34:11.886 INFO:teuthology.orchestra.run.smithi197.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:34:11.886 INFO:teuthology.orchestra.run.smithi197.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:34:11.886 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:34:11.886 INFO:teuthology.orchestra.run.smithi197.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:34:11.887 INFO:teuthology.orchestra.run.smithi197.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:34:11.888 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:34:11.888 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:34:11.888 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:11.888 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:12.153 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:12.167 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-base 2020-04-28T12:34:12.607 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:01 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:12.888 INFO:teuthology.orchestra.run.smithi197.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:12.990 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:12.991 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:12.991 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:13.092 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:13.106 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install cephadm 2020-04-28T12:34:13.537 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:02 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:13.890 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:13.891 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:13.891 INFO:teuthology.orchestra.run.smithi197.stdout: Package Architecture Version Repository Size 2020-04-28T12:34:13.891 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:13.891 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:13.891 INFO:teuthology.orchestra.run.smithi197.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:34:13.891 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:13.891 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:13.892 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:13.892 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2020-04-28T12:34:13.892 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:13.892 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 41 k 2020-04-28T12:34:13.892 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 161 k 2020-04-28T12:34:13.893 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:14.116 INFO:teuthology.orchestra.run.smithi197.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 182 kB/s | 41 kB 00:00 2020-04-28T12:34:14.116 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:14.117 INFO:teuthology.orchestra.run.smithi197.stdout:Total 182 kB/s | 41 kB 00:00 2020-04-28T12:34:14.119 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:14.126 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:14.126 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:14.127 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:14.128 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:14.168 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:15.318 INFO:teuthology.orchestra.run.smithi066.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 23 kB/s | 164 kB 00:07 2020-04-28T12:34:15.375 INFO:teuthology.orchestra.run.smithi066.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 3.7 MB/s | 214 kB 00:00 2020-04-28T12:34:15.393 INFO:teuthology.orchestra.run.smithi066.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2020-04-28T12:34:15.396 INFO:teuthology.orchestra.run.smithi066.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2020-04-28T12:34:15.398 INFO:teuthology.orchestra.run.smithi066.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 26 MB/s | 39 kB 00:00 2020-04-28T12:34:15.400 INFO:teuthology.orchestra.run.smithi066.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 30 MB/s | 54 kB 00:00 2020-04-28T12:34:15.402 INFO:teuthology.orchestra.run.smithi066.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 21 MB/s | 27 kB 00:00 2020-04-28T12:34:15.408 INFO:teuthology.orchestra.run.smithi066.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 72 MB/s | 457 kB 00:00 2020-04-28T12:34:15.464 INFO:teuthology.orchestra.run.smithi066.stdout:(12/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.5 MB/s | 145 kB 00:00 2020-04-28T12:34:15.486 INFO:teuthology.orchestra.run.smithi066.stdout:(13/32): python3-cherrypy-18.4.0-1.el8.noarch.r 17 MB/s | 385 kB 00:00 2020-04-28T12:34:15.494 INFO:teuthology.orchestra.run.smithi066.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-28T12:34:15.511 INFO:teuthology.orchestra.run.smithi066.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 2.1 MB/s | 18 kB 00:00 2020-04-28T12:34:15.518 INFO:teuthology.orchestra.run.smithi066.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 3.1 MB/s | 49 kB 00:00 2020-04-28T12:34:15.527 INFO:teuthology.orchestra.run.smithi066.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 6.6 MB/s | 59 kB 00:00 2020-04-28T12:34:15.539 INFO:teuthology.orchestra.run.smithi066.stdout:(18/32): python3-pecan-1.3.2-9.el8.noarch.rpm 23 MB/s | 283 kB 00:00 2020-04-28T12:34:15.547 INFO:teuthology.orchestra.run.smithi066.stdout:(19/32): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-28T12:34:15.556 INFO:teuthology.orchestra.run.smithi066.stdout:(20/32): python3-simplegeneric-0.8.1-17.el8.noa 2.2 MB/s | 19 kB 00:00 2020-04-28T12:34:15.565 INFO:teuthology.orchestra.run.smithi066.stdout:(21/32): python3-singledispatch-3.4.0.3-18.el8. 2.8 MB/s | 24 kB 00:00 2020-04-28T12:34:15.573 INFO:teuthology.orchestra.run.smithi066.stdout:(22/32): python3-tempora-1.14.1-5.el8.noarch.rp 3.6 MB/s | 30 kB 00:00 2020-04-28T12:34:15.581 INFO:teuthology.orchestra.run.smithi066.stdout:(23/32): python3-trustme-0.5.2-4.el8.noarch.rpm 3.2 MB/s | 27 kB 00:00 2020-04-28T12:34:15.590 INFO:teuthology.orchestra.run.smithi066.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.6 MB/s | 23 kB 00:00 2020-04-28T12:34:15.667 INFO:teuthology.orchestra.run.smithi066.stdout:(25/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 572 kB/s | 44 kB 00:00 2020-04-28T12:34:15.723 INFO:teuthology.orchestra.run.smithi066.stdout:(26/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.2 MB/s | 185 kB 00:00 2020-04-28T12:34:15.742 INFO:teuthology.orchestra.run.smithi066.stdout:(27/32): python3-cssselect-0.9.2-10.el8.noarch. 2.0 MB/s | 40 kB 00:00 2020-04-28T12:34:15.781 INFO:teuthology.orchestra.run.smithi066.stdout:(28/32): python3-waitress-1.2.1-2.el8.1.noarch. 6.2 MB/s | 241 kB 00:00 2020-04-28T12:34:15.802 INFO:teuthology.orchestra.run.smithi066.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 12 MB/s | 251 kB 00:00 2020-04-28T12:34:15.821 INFO:teuthology.orchestra.run.smithi066.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 4.3 MB/s | 85 kB 00:00 2020-04-28T12:34:15.869 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:16.156 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:16.352 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:16.352 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:16.352 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:16.352 INFO:teuthology.orchestra.run.smithi197.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:16.353 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:16.353 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:16.457 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:16.479 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:34:16.866 INFO:teuthology.orchestra.run.smithi066.stdout:(31/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 318 kB/s | 4.4 MB 00:14 2020-04-28T12:34:16.921 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:05 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:17.274 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:17.275 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:17.275 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2020-04-28T12:34:17.275 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:17.275 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:17.276 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:34:17.276 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:17.276 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:17.276 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:17.276 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2020-04-28T12:34:17.276 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:17.277 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 203 k 2020-04-28T12:34:17.277 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 743 k 2020-04-28T12:34:17.277 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:17.906 INFO:teuthology.orchestra.run.smithi197.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 323 kB/s | 203 kB 00:00 2020-04-28T12:34:17.907 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:17.907 INFO:teuthology.orchestra.run.smithi197.stdout:Total 322 kB/s | 203 kB 00:00 2020-04-28T12:34:17.914 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:17.922 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:17.922 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:17.967 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:17.968 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:18.080 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:18.291 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:34:18.299 INFO:teuthology.orchestra.run.smithi066.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 1.6 MB/s | 17 MB 00:10 2020-04-28T12:34:18.303 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:18.304 INFO:teuthology.orchestra.run.smithi066.stdout:Total 1.7 MB/s | 29 MB 00:16 2020-04-28T12:34:18.312 INFO:teuthology.orchestra.run.smithi066.stderr:warning: /var/cache/dnf/copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8-0161c520b1c9fbf7/packages/python3-cheroot-8.2.1-1.el8.noarch.rpm: Header V3 RSA/SHA1 Signature, key ID 2a8a41ec: NOKEY 2020-04-28T12:34:18.363 INFO:teuthology.orchestra.run.smithi066.stdout:Copr repo for ceph-el8 owned by ktdreyer 23 kB/s | 1.0 kB 00:00 2020-04-28T12:34:18.475 INFO:teuthology.orchestra.run.smithi066.stderr:Importing GPG key 0x2A8A41EC: 2020-04-28T12:34:18.475 INFO:teuthology.orchestra.run.smithi066.stderr: Userid : "ktdreyer_ceph-el8 (None) " 2020-04-28T12:34:18.475 INFO:teuthology.orchestra.run.smithi066.stderr: Fingerprint: 64D3 346F FD63 5D2D B5D0 5873 1014 BDBE 2A8A 41EC 2020-04-28T12:34:18.475 INFO:teuthology.orchestra.run.smithi066.stderr: From : https://download.copr.fedorainfracloud.org/results/ktdreyer/ceph-el8/pubkey.gpg 2020-04-28T12:34:18.559 INFO:teuthology.orchestra.run.smithi066.stdout:Key imported successfully 2020-04-28T12:34:18.573 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:34:18.601 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:34:18.617 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:34:18.617 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:34:18.860 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:34:18.860 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:18.861 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:18.861 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:18.861 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:18.861 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:18.923 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:34:18.923 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:34:19.121 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:19.136 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr 2020-04-28T12:34:19.573 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:08 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:19.835 INFO:teuthology.orchestra.run.smithi197.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:19.936 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:19.937 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:19.937 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:20.219 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:20.232 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:34:20.660 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:09 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:20.862 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:34:21.022 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:21.023 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:21.023 INFO:teuthology.orchestra.run.smithi197.stdout: Package ArchVersion Repository Size 2020-04-28T12:34:21.023 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:21.023 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:21.024 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:34:21.024 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:34:21.024 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:34:21.024 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:34:21.024 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:34:21.024 INFO:teuthology.orchestra.run.smithi197.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:34:21.024 INFO:teuthology.orchestra.run.smithi197.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:34:21.025 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:21.025 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:21.025 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:21.025 INFO:teuthology.orchestra.run.smithi197.stdout:Install 6 Packages 2020-04-28T12:34:21.025 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:21.026 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 3.6 M 2020-04-28T12:34:21.026 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 19 M 2020-04-28T12:34:21.026 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:21.121 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:34:21.182 INFO:teuthology.orchestra.run.smithi197.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 56 kB/s | 8.8 kB 00:00 2020-04-28T12:34:21.220 INFO:teuthology.orchestra.run.smithi197.stdout:(2/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 115 kB/s | 22 kB 00:00 2020-04-28T12:34:21.236 INFO:teuthology.orchestra.run.smithi197.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 798 kB/s | 43 kB 00:00 2020-04-28T12:34:21.269 INFO:teuthology.orchestra.run.smithi197.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 693 kB/s | 34 kB 00:00 2020-04-28T12:34:21.297 INFO:teuthology.orchestra.run.smithi197.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.1 MB/s | 197 kB 00:00 2020-04-28T12:34:21.351 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:34:21.487 INFO:teuthology.orchestra.run.smithi197.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 7.2 MB/s | 3.3 MB 00:00 2020-04-28T12:34:21.490 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:21.490 INFO:teuthology.orchestra.run.smithi197.stdout:Total 7.8 MB/s | 3.6 MB 00:00 2020-04-28T12:34:21.495 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:21.503 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:21.503 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:21.570 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:34:21.610 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:21.610 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:21.735 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:34:21.862 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:22.051 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:34:22.076 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:34:22.217 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:34:22.273 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:34:22.399 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:34:22.416 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:34:22.530 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:34:22.545 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:34:22.722 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:34:22.903 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:34:23.017 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:34:23.218 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:34:23.460 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:34:23.608 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:34:23.636 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:34:23.865 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:34:23.895 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:34:24.090 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:34:24.099 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:34:24.100 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:34:24.100 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:34:24.100 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:34:24.100 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:34:24.100 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:34:24.343 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:34:24.343 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:24.343 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:24.343 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:24.343 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:24.343 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:24.344 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:34:24.344 INFO:teuthology.orchestra.run.smithi197.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:34:24.344 INFO:teuthology.orchestra.run.smithi197.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:34:24.344 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:24.344 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:24.463 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:24.476 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:34:24.491 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:34:24.763 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:34:24.909 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:13 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:24.973 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:34:25.253 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:34:25.414 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:34:25.630 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:34:25.767 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:25.768 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:25.768 INFO:teuthology.orchestra.run.smithi197.stdout: Package ArchVersion Repository Size 2020-04-28T12:34:25.769 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:25.769 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:25.769 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:34:25.769 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:34:25.769 INFO:teuthology.orchestra.run.smithi197.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:34:25.770 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:34:25.770 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:34:25.770 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:34:25.770 INFO:teuthology.orchestra.run.smithi197.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:34:25.770 INFO:teuthology.orchestra.run.smithi197.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:34:25.771 INFO:teuthology.orchestra.run.smithi197.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:34:25.771 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:25.771 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:25.771 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:25.771 INFO:teuthology.orchestra.run.smithi197.stdout:Install 8 Packages 2020-04-28T12:34:25.772 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:25.772 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 37 M 2020-04-28T12:34:25.773 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 205 M 2020-04-28T12:34:25.773 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:25.955 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:34:25.959 INFO:teuthology.orchestra.run.smithi197.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 23 MB/s | 4.3 MB 00:00 2020-04-28T12:34:26.036 INFO:teuthology.orchestra.run.smithi197.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 49 MB/s | 3.7 MB 00:00 2020-04-28T12:34:26.070 INFO:teuthology.orchestra.run.smithi197.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 6.5 MB/s | 225 kB 00:00 2020-04-28T12:34:26.144 INFO:teuthology.orchestra.run.smithi197.stdout:(4/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2020-04-28T12:34:26.174 INFO:teuthology.orchestra.run.smithi197.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 21 MB/s | 638 kB 00:00 2020-04-28T12:34:26.182 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:34:26.251 INFO:teuthology.orchestra.run.smithi197.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 2.2 MB/s | 169 kB 00:00 2020-04-28T12:34:26.457 INFO:teuthology.orchestra.run.smithi197.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 38 MB/s | 15 MB 00:00 2020-04-28T12:34:26.533 INFO:teuthology.orchestra.run.smithi197.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 11 MB/s | 8.6 MB 00:00 2020-04-28T12:34:26.536 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:26.536 INFO:teuthology.orchestra.run.smithi197.stdout:Total 48 MB/s | 37 MB 00:00 2020-04-28T12:34:26.546 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:26.557 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:34:26.565 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:26.565 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:26.844 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:34:26.879 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:26.880 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:27.135 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:34:27.278 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:34:27.541 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:27.696 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:34:27.833 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:34:27.988 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:34:28.571 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:34:28.748 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:34:28.786 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:34:28.949 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:34:29.293 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:34:29.357 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:34:29.438 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:34:29.541 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:34:29.746 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:34:29.891 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:34:29.935 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:34:30.039 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:34:30.133 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:34:30.367 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:34:30.367 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:34:30.367 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:34:30.367 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:34:30.367 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:34:30.368 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:34:30.368 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:34:30.368 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:34:30.368 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:34:30.368 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:34:30.368 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:34:30.368 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:34:30.369 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:34:30.369 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:34:30.369 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:34:30.371 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:34:30.371 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:34:30.371 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:34:30.371 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:34:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:34:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:34:30.373 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:34:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:34:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:34:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:34:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:34:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:34:30.374 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:34:30.375 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:34:30.375 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:34:30.375 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:34:30.375 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:34:30.425 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:34:30.704 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:34:32.664 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:34:32.776 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:34:32.777 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:32.777 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:34:32.777 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:32.777 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:34:32.777 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:34:32.777 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:32.778 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:32.778 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:32.778 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:32.778 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:32.778 INFO:teuthology.orchestra.run.smithi066.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:34:32.778 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:34:32.778 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:34:32.779 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:34:32.779 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:34:32.779 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:34:32.779 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:34:32.779 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:34:32.779 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:34:32.779 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:34:32.780 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:34:32.780 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:34:32.780 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:34:32.780 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:34:32.780 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:34:32.780 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:34:32.780 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:34:32.781 INFO:teuthology.orchestra.run.smithi066.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:34:32.781 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:34:32.781 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:34:32.781 INFO:teuthology.orchestra.run.smithi066.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:34:32.781 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:34:32.781 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:34:32.781 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:34:32.782 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:32.782 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:33.034 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:33.049 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-base 2020-04-28T12:34:33.515 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:22 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:33.891 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:33.892 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:34:33.892 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:33.985 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:34:34.001 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:34.015 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install cephadm 2020-04-28T12:34:34.179 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:34:34.434 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:34:34.435 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:34:34.435 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:34:34.435 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:34:34.435 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:34:34.435 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:34:34.436 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:34:34.436 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:34:34.475 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:23 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:34.691 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:34:34.692 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:34.692 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:34.692 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:34.692 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:34:34.693 INFO:teuthology.orchestra.run.smithi197.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:34:34.693 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:34:34.693 INFO:teuthology.orchestra.run.smithi197.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:34:34.693 INFO:teuthology.orchestra.run.smithi197.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:34:34.693 INFO:teuthology.orchestra.run.smithi197.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:34:34.694 INFO:teuthology.orchestra.run.smithi197.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:34:34.694 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:34.694 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:34.836 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:34.850 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:34:34.866 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:34.867 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:34.867 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2020-04-28T12:34:34.867 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:34.867 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:34:34.868 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:34:34.868 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:34.868 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:34:34.868 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:34.868 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2020-04-28T12:34:34.868 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:34.869 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 41 k 2020-04-28T12:34:34.869 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 161 k 2020-04-28T12:34:34.869 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:34:35.092 INFO:teuthology.orchestra.run.smithi066.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 182 kB/s | 41 kB 00:00 2020-04-28T12:34:35.093 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:35.093 INFO:teuthology.orchestra.run.smithi066.stdout:Total 182 kB/s | 41 kB 00:00 2020-04-28T12:34:35.095 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:34:35.103 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:34:35.103 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:34:35.105 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:34:35.105 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:34:35.150 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:34:35.282 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:24 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:35.648 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:35.649 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:35.650 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2020-04-28T12:34:35.650 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:35.650 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:35.650 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:34:35.651 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-noarch 27 k 2020-04-28T12:34:35.651 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:34:35.651 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:34:35.651 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:34:35.651 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:34:35.651 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:34:35.651 INFO:teuthology.orchestra.run.smithi197.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:34:35.652 INFO:teuthology.orchestra.run.smithi197.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:34:35.652 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:34:35.652 INFO:teuthology.orchestra.run.smithi197.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:34:35.652 INFO:teuthology.orchestra.run.smithi197.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:34:35.652 INFO:teuthology.orchestra.run.smithi197.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:34:35.652 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:34:35.652 INFO:teuthology.orchestra.run.smithi197.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:34:35.653 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:35.653 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:35.653 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:35.653 INFO:teuthology.orchestra.run.smithi197.stdout:Install 13 Packages 2020-04-28T12:34:35.653 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:35.654 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 1.9 M 2020-04-28T12:34:35.654 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 23 M 2020-04-28T12:34:35.654 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:35.683 INFO:teuthology.orchestra.run.smithi197.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 886 kB/s | 27 kB 00:00 2020-04-28T12:34:35.686 INFO:teuthology.orchestra.run.smithi197.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 37 MB/s | 126 kB 00:00 2020-04-28T12:34:35.687 INFO:teuthology.orchestra.run.smithi197.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 587 kB/s | 20 kB 00:00 2020-04-28T12:34:35.690 INFO:teuthology.orchestra.run.smithi197.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 35 MB/s | 110 kB 00:00 2020-04-28T12:34:35.697 INFO:teuthology.orchestra.run.smithi197.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 17 MB/s | 155 kB 00:00 2020-04-28T12:34:35.697 INFO:teuthology.orchestra.run.smithi197.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 22 MB/s | 43 kB 00:00 2020-04-28T12:34:35.753 INFO:teuthology.orchestra.run.smithi197.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 583 kB/s | 33 kB 00:00 2020-04-28T12:34:35.753 INFO:teuthology.orchestra.run.smithi197.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 289 kB/s | 16 kB 00:00 2020-04-28T12:34:35.790 INFO:teuthology.orchestra.run.smithi197.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 2.1 MB/s | 81 kB 00:00 2020-04-28T12:34:35.809 INFO:teuthology.orchestra.run.smithi197.stdout:(10/13): python3-rsa-3.4.2-12.el8.noarch.rpm 3.7 MB/s | 73 kB 00:00 2020-04-28T12:34:35.829 INFO:teuthology.orchestra.run.smithi197.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.1 MB/s | 61 kB 00:00 2020-04-28T12:34:35.840 INFO:teuthology.orchestra.run.smithi197.stdout:(12/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.e 145 kB/s | 27 kB 00:00 2020-04-28T12:34:35.867 INFO:teuthology.orchestra.run.smithi197.stdout:(13/13): python3-kubernetes-10.0.1-2.el8.noarch 9.8 MB/s | 1.1 MB 00:00 2020-04-28T12:34:35.869 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:35.869 INFO:teuthology.orchestra.run.smithi197.stdout:Total 8.6 MB/s | 1.9 MB 00:00 2020-04-28T12:34:35.875 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:35.889 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:35.889 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:35.959 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:35.959 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:36.447 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:36.506 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:36.674 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:34:36.785 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:36.998 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:36.999 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:36.999 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:34:36.999 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:36.999 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:36.999 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:37.113 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:37.129 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:34:37.261 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:34:37.507 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:34:37.600 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:26 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:37.753 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:34:37.969 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:34:37.985 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:37.986 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:37.986 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-04-28T12:34:37.986 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:37.986 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:34:37.986 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:34:37.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:37.987 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:34:37.987 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:37.987 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2020-04-28T12:34:37.987 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:37.988 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 203 k 2020-04-28T12:34:37.988 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 743 k 2020-04-28T12:34:37.988 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:34:38.212 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:34:38.512 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:34:38.556 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 357 kB/s | 203 kB 00:00 2020-04-28T12:34:38.557 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:38.557 INFO:teuthology.orchestra.run.smithi066.stdout:Total 356 kB/s | 203 kB 00:00 2020-04-28T12:34:38.559 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:34:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:34:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:34:38.622 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:34:38.622 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:34:38.718 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:34:38.774 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:34:38.931 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:34:39.277 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:34:39.548 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:34:39.548 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:39.548 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:34:39.549 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:39.549 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:39.549 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:39.768 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:34:39.791 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:39.805 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr 2020-04-28T12:34:40.035 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:34:40.219 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:34:40.268 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:29 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:40.402 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:34:40.525 INFO:teuthology.orchestra.run.smithi066.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:40.602 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:34:40.631 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:40.632 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:34:40.632 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:40.760 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:40.774 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:34:40.797 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:34:40.798 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:34:40.798 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:34:40.798 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:34:40.798 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:34:40.798 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:34:40.799 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:34:40.799 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:34:40.799 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:34:40.799 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:34:40.799 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:34:40.799 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:34:40.799 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:34:41.131 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:34:41.131 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:41.131 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:41.131 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:41.131 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:34:41.131 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:34:41.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:34:41.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:34:41.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:34:41.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:34:41.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:34:41.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:34:41.132 INFO:teuthology.orchestra.run.smithi197.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:34:41.133 INFO:teuthology.orchestra.run.smithi197.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:34:41.133 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:34:41.133 INFO:teuthology.orchestra.run.smithi197.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:34:41.133 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:41.133 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:41.233 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:30 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:41.244 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:41.258 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:34:41.640 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:41.641 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:41.641 INFO:teuthology.orchestra.run.smithi066.stdout: Package ArchVersion Repository Size 2020-04-28T12:34:41.641 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:41.641 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:34:41.641 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:34:41.641 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:34:41.641 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:34:41.642 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:34:41.642 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:34:41.642 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:34:41.642 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:34:41.642 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:41.642 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:34:41.643 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:41.643 INFO:teuthology.orchestra.run.smithi066.stdout:Install 6 Packages 2020-04-28T12:34:41.643 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:41.643 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 3.6 M 2020-04-28T12:34:41.644 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 19 M 2020-04-28T12:34:41.644 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:34:41.695 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:30 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:41.803 INFO:teuthology.orchestra.run.smithi066.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 55 kB/s | 8.8 kB 00:00 2020-04-28T12:34:41.830 INFO:teuthology.orchestra.run.smithi066.stdout:(2/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 120 kB/s | 22 kB 00:00 2020-04-28T12:34:41.834 INFO:teuthology.orchestra.run.smithi066.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2020-04-28T12:34:41.879 INFO:teuthology.orchestra.run.smithi066.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 711 kB/s | 34 kB 00:00 2020-04-28T12:34:41.898 INFO:teuthology.orchestra.run.smithi066.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.0 MB/s | 197 kB 00:00 2020-04-28T12:34:42.049 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:42.050 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:42.050 INFO:teuthology.orchestra.run.smithi197.stdout: Package ArchVersion Repository Size 2020-04-28T12:34:42.050 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:42.050 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:42.050 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:34:42.051 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:34:42.051 INFO:teuthology.orchestra.run.smithi197.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:34:42.051 INFO:teuthology.orchestra.run.smithi197.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:34:42.051 INFO:teuthology.orchestra.run.smithi197.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:34:42.051 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:42.051 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:42.051 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:42.052 INFO:teuthology.orchestra.run.smithi197.stdout:Install 4 Packages 2020-04-28T12:34:42.052 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:42.052 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 467 k 2020-04-28T12:34:42.052 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 1.4 M 2020-04-28T12:34:42.053 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:42.106 INFO:teuthology.orchestra.run.smithi197.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 884 kB/s | 48 kB 00:00 2020-04-28T12:34:42.112 INFO:teuthology.orchestra.run.smithi066.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 7.1 MB/s | 3.3 MB 00:00 2020-04-28T12:34:42.116 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:42.117 INFO:teuthology.orchestra.run.smithi066.stdout:Total 7.7 MB/s | 3.6 MB 00:00 2020-04-28T12:34:42.120 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:34:42.123 INFO:teuthology.orchestra.run.smithi197.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 4.9 MB/s | 356 kB 00:00 2020-04-28T12:34:42.129 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:34:42.130 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:34:42.164 INFO:teuthology.orchestra.run.smithi197.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 371 kB/s | 21 kB 00:00 2020-04-28T12:34:42.235 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:34:42.236 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:34:42.287 INFO:teuthology.orchestra.run.smithi197.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 177 kB/s | 42 kB 00:00 2020-04-28T12:34:42.289 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:42.289 INFO:teuthology.orchestra.run.smithi197.stdout:Total 1.9 MB/s | 467 kB 00:00 2020-04-28T12:34:42.293 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:42.299 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:42.300 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:42.330 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:42.330 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:42.500 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:34:42.715 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:34:42.933 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:34:43.083 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:34:43.220 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:34:43.288 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:43.590 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:34:43.873 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:34:44.067 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:34:44.269 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:34:44.337 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:34:44.473 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:34:44.473 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:34:44.473 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:34:44.473 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:34:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:34:44.698 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:34:44.698 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:44.699 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:44.699 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:44.699 INFO:teuthology.orchestra.run.smithi197.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:34:44.699 INFO:teuthology.orchestra.run.smithi197.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:34:44.699 INFO:teuthology.orchestra.run.smithi197.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:34:44.699 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:44.700 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:44.780 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:34:44.781 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:34:44.781 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:34:44.781 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:34:44.781 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:34:44.781 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:34:44.826 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:44.839 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install ceph-fuse 2020-04-28T12:34:45.031 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:34:45.031 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:45.031 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:34:45.031 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:45.032 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:45.032 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:45.032 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:34:45.032 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:34:45.032 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:34:45.032 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:45.032 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:45.182 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:45.196 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:34:45.275 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:34 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:45.648 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:45.649 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:45.649 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2020-04-28T12:34:45.649 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:45.649 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:45.650 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:34:45.650 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:34:45.650 INFO:teuthology.orchestra.run.smithi197.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:34:45.650 INFO:teuthology.orchestra.run.smithi197.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:34:45.650 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:45.650 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:45.650 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:45.651 INFO:teuthology.orchestra.run.smithi197.stdout:Install 3 Packages 2020-04-28T12:34:45.651 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:45.651 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 676 k 2020-04-28T12:34:45.651 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 2.1 M 2020-04-28T12:34:45.652 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:45.657 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:34 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:45.682 INFO:teuthology.orchestra.run.smithi197.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2020-04-28T12:34:45.685 INFO:teuthology.orchestra.run.smithi197.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 625 kB/s | 21 kB 00:00 2020-04-28T12:34:46.041 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:46.042 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:46.042 INFO:teuthology.orchestra.run.smithi066.stdout: Package ArchVersion Repository Size 2020-04-28T12:34:46.042 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:46.042 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:34:46.042 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:34:46.043 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:34:46.043 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:34:46.043 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:34:46.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:34:46.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:34:46.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:34:46.044 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:34:46.044 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:34:46.044 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:46.044 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:34:46.044 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:46.044 INFO:teuthology.orchestra.run.smithi066.stdout:Install 8 Packages 2020-04-28T12:34:46.044 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:46.045 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 37 M 2020-04-28T12:34:46.045 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 205 M 2020-04-28T12:34:46.045 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:34:46.047 INFO:teuthology.orchestra.run.smithi197.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 1.4 MB/s | 572 kB 00:00 2020-04-28T12:34:46.049 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:46.049 INFO:teuthology.orchestra.run.smithi197.stdout:Total 1.7 MB/s | 676 kB 00:00 2020-04-28T12:34:46.053 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:46.073 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:46.073 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:46.135 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:46.136 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:46.176 INFO:teuthology.orchestra.run.smithi066.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 33 MB/s | 4.3 MB 00:00 2020-04-28T12:34:46.190 INFO:teuthology.orchestra.run.smithi066.stdout:(2/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2020-04-28T12:34:46.197 INFO:teuthology.orchestra.run.smithi066.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 34 MB/s | 225 kB 00:00 2020-04-28T12:34:46.257 INFO:teuthology.orchestra.run.smithi066.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 46 MB/s | 3.7 MB 00:00 2020-04-28T12:34:46.271 INFO:teuthology.orchestra.run.smithi066.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 46 MB/s | 638 kB 00:00 2020-04-28T12:34:46.277 INFO:teuthology.orchestra.run.smithi066.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 29 MB/s | 169 kB 00:00 2020-04-28T12:34:46.304 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:46.305 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:34:46.305 INFO:teuthology.orchestra.run.smithi197.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:34:46.305 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:46.483 INFO:teuthology.orchestra.run.smithi066.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 51 MB/s | 15 MB 00:00 2020-04-28T12:34:46.743 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:34:46.959 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:34:47.261 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:34:47.261 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:34:47.261 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:34:47.589 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:34:47.590 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:47.590 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:47.590 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:34:47.590 INFO:teuthology.orchestra.run.smithi197.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:34:47.590 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:47.590 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:47.903 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:47.917 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install librados-devel 2020-04-28T12:34:48.358 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:37 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:48.784 INFO:teuthology.orchestra.run.smithi066.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 3.1 MB/s | 8.6 MB 00:02 2020-04-28T12:34:48.786 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:48.787 INFO:teuthology.orchestra.run.smithi066.stdout:Total 13 MB/s | 37 MB 00:02 2020-04-28T12:34:48.799 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:34:48.821 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:34:48.821 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:34:49.072 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:49.073 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:49.073 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2020-04-28T12:34:49.073 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:49.073 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:49.074 INFO:teuthology.orchestra.run.smithi197.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:34:49.074 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:49.074 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:49.074 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:49.074 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2020-04-28T12:34:49.075 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:49.075 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 141 k 2020-04-28T12:34:49.075 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 487 k 2020-04-28T12:34:49.075 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:49.141 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:34:49.141 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:34:49.691 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:34:49.766 INFO:teuthology.orchestra.run.smithi197.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 204 kB/s | 141 kB 00:00 2020-04-28T12:34:49.766 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:49.767 INFO:teuthology.orchestra.run.smithi197.stdout:Total 203 kB/s | 141 kB 00:00 2020-04-28T12:34:49.769 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:49.776 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:49.776 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:49.822 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:34:49.826 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:49.827 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:49.939 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:34:49.961 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:50.080 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:34:50.141 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:50.345 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:50.617 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:50.617 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:50.617 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:50.617 INFO:teuthology.orchestra.run.smithi197.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:50.617 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:50.617 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:50.653 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:34:50.822 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:34:50.898 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:50.912 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install libcephfs2 2020-04-28T12:34:51.352 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:40 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:51.408 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:34:51.546 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:34:51.599 INFO:teuthology.orchestra.run.smithi197.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:51.701 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:51.702 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:51.702 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:51.820 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:51.834 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install libcephfs-devel 2020-04-28T12:34:52.269 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:41 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:52.317 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:34:52.622 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:34:52.635 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:52.636 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:52.636 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2020-04-28T12:34:52.637 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:52.637 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:34:52.637 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:34:52.637 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:52.637 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:34:52.637 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:34:52.638 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2020-04-28T12:34:52.638 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:52.638 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 21 k 2020-04-28T12:34:52.638 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 76 k 2020-04-28T12:34:52.639 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:34:52.829 INFO:teuthology.orchestra.run.smithi197.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 111 kB/s | 21 kB 00:00 2020-04-28T12:34:52.830 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:52.830 INFO:teuthology.orchestra.run.smithi197.stdout:Total 111 kB/s | 21 kB 00:00 2020-04-28T12:34:52.832 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:34:52.835 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:34:52.836 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:34:52.838 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:34:52.838 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:34:52.885 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:34:53.082 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:53.250 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:34:53.264 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:53.461 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:34:53.462 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:53.462 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:34:53.462 INFO:teuthology.orchestra.run.smithi197.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:34:53.462 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:34:53.462 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:53.609 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:53.622 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install librados2 2020-04-28T12:34:54.059 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:43 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:54.741 INFO:teuthology.orchestra.run.smithi197.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:54.844 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:54.845 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:54.845 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:54.961 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:54.974 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install librbd1 2020-04-28T12:34:55.369 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:34:55.408 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:44 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:55.673 INFO:teuthology.orchestra.run.smithi197.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:55.778 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:55.779 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:55.781 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:55.894 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:55.908 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-rados 2020-04-28T12:34:56.342 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:45 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:56.598 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:56.703 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:56.703 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:56.703 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:56.704 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:34:56.844 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:56.857 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-rgw 2020-04-28T12:34:56.937 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:34:57.184 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:34:57.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:34:57.184 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:34:57.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:34:57.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:34:57.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:34:57.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:34:57.185 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:34:57.292 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:46 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:57.446 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:34:57.446 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:57.447 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:34:57.447 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:34:57.447 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:34:57.447 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:34:57.447 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:34:57.447 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:34:57.447 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:34:57.448 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:34:57.448 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:34:57.448 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:57.448 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:34:57.540 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:57.558 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:34:57.572 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:34:57.645 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:57.647 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:57.647 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:57.761 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:57.774 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-cephfs 2020-04-28T12:34:58.036 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:47 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:58.210 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:47 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:34:58.418 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:58.418 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2020-04-28T12:34:58.418 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:58.419 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:34:58.419 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:34:58.419 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-noarch 27 k 2020-04-28T12:34:58.419 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:34:58.419 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:34:58.419 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:34:58.420 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:34:58.420 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:34:58.420 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:34:58.420 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:58.421 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:34:58.422 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:34:58.422 INFO:teuthology.orchestra.run.smithi066.stdout:Install 13 Packages 2020-04-28T12:34:58.422 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:34:58.423 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 1.9 M 2020-04-28T12:34:58.423 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 23 M 2020-04-28T12:34:58.423 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:34:58.456 INFO:teuthology.orchestra.run.smithi066.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 778 kB/s | 27 kB 00:00 2020-04-28T12:34:58.467 INFO:teuthology.orchestra.run.smithi066.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 442 kB/s | 20 kB 00:00 2020-04-28T12:34:58.467 INFO:teuthology.orchestra.run.smithi066.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 11 MB/s | 126 kB 00:00 2020-04-28T12:34:58.473 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:58.507 INFO:teuthology.orchestra.run.smithi066.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.6 MB/s | 110 kB 00:00 2020-04-28T12:34:58.547 INFO:teuthology.orchestra.run.smithi066.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.9 MB/s | 155 kB 00:00 2020-04-28T12:34:58.575 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:58.576 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:58.577 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:58.651 INFO:teuthology.orchestra.run.smithi066.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 299 kB/s | 43 kB 00:00 2020-04-28T12:34:58.651 INFO:teuthology.orchestra.run.smithi066.stdout:(7/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.el 118 kB/s | 27 kB 00:00 2020-04-28T12:34:58.692 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:58.705 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install python3-rbd 2020-04-28T12:34:58.739 INFO:teuthology.orchestra.run.smithi066.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 172 kB/s | 33 kB 00:00 2020-04-28T12:34:58.755 INFO:teuthology.orchestra.run.smithi066.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 157 kB/s | 16 kB 00:00 2020-04-28T12:34:58.823 INFO:teuthology.orchestra.run.smithi066.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 472 kB/s | 81 kB 00:00 2020-04-28T12:34:58.859 INFO:teuthology.orchestra.run.smithi066.stdout:(11/13): python3-rsa-3.4.2-12.el8.noarch.rpm 699 kB/s | 73 kB 00:00 2020-04-28T12:34:58.939 INFO:teuthology.orchestra.run.smithi066.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 533 kB/s | 61 kB 00:00 2020-04-28T12:34:58.962 INFO:teuthology.orchestra.run.smithi066.stdout:(13/13): python3-kubernetes-10.0.1-2.el8.noarch 5.0 MB/s | 1.1 MB 00:00 2020-04-28T12:34:58.965 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:34:58.965 INFO:teuthology.orchestra.run.smithi066.stdout:Total 3.4 MB/s | 1.9 MB 00:00 2020-04-28T12:34:58.974 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:34:58.991 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:34:58.992 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:34:59.077 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:34:59.077 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:34:59.139 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:48 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:34:59.398 INFO:teuthology.orchestra.run.smithi197.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:34:59.501 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:34:59.502 INFO:teuthology.orchestra.run.smithi197.stdout:Nothing to do. 2020-04-28T12:34:59.502 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:34:59.627 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:34:59.643 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install rbd-fuse 2020-04-28T12:34:59.663 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:34:59.945 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:35:00.082 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:49 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:00.176 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:35:00.358 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:35:00.599 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:35:00.600 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:00.600 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2020-04-28T12:35:00.601 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:00.601 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:35:00.601 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:35:00.601 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:00.601 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:35:00.602 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:00.602 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2020-04-28T12:35:00.602 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:00.602 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 72 k 2020-04-28T12:35:00.602 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 230 k 2020-04-28T12:35:00.602 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:35:00.616 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:35:00.824 INFO:teuthology.orchestra.run.smithi197.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 324 kB/s | 72 kB 00:00 2020-04-28T12:35:00.825 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:00.825 INFO:teuthology.orchestra.run.smithi197.stdout:Total 322 kB/s | 72 kB 00:00 2020-04-28T12:35:00.827 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:35:00.837 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:35:00.838 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:35:00.838 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:35:00.892 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:35:00.995 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:35:00.998 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:35:01.108 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:35:01.191 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:01.353 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:35:01.378 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:01.593 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:01.593 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:01.593 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:35:01.593 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:01.594 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:01.594 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:35:01.603 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:35:01.851 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:01.865 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install rbd-mirror 2020-04-28T12:35:02.308 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:51 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:02.684 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:35:02.684 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:02.684 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repo Size 2020-04-28T12:35:02.684 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:02.685 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:35:02.685 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:35:02.685 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:02.685 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:35:02.685 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:02.685 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2020-04-28T12:35:02.685 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:02.686 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 2.7 M 2020-04-28T12:35:02.686 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 13 M 2020-04-28T12:35:02.686 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:35:02.726 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:35:03.011 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:35:03.228 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:35:03.274 INFO:teuthology.orchestra.run.smithi197.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 4.6 MB/s | 2.7 MB 00:00 2020-04-28T12:35:03.275 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:03.275 INFO:teuthology.orchestra.run.smithi197.stdout:Total 4.6 MB/s | 2.7 MB 00:00 2020-04-28T12:35:03.277 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:35:03.290 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:35:03.290 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:35:03.348 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:35:03.348 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:35:03.395 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:35:03.577 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:35:03.706 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:35:03.794 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:35:03.795 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:35:03.795 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:35:03.795 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:35:03.795 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:35:03.795 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:35:03.795 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:35:03.796 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:35:03.796 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:35:03.796 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:35:03.796 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:35:03.796 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:35:03.796 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:35:03.908 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:04.207 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:04.295 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:35:04.295 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:04.295 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:04.295 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:35:04.296 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:35:04.296 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:35:04.296 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:35:04.296 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:35:04.296 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:35:04.296 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:35:04.296 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:35:04.297 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:35:04.297 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:35:04.297 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:35:04.297 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:35:04.297 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:35:04.297 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:04.297 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:04.419 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:04.433 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:35:04.445 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:04.445 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:04.445 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:35:04.445 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:04.445 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:04.446 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:35:04.779 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:04.794 INFO:teuthology.orchestra.run.smithi197:> sudo yum -y install rbd-nbd 2020-04-28T12:35:04.901 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:53 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:05.237 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:01:54 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:05.288 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:05.289 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:05.289 INFO:teuthology.orchestra.run.smithi066.stdout: Package ArchVersion Repository Size 2020-04-28T12:35:05.289 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:05.289 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:35:05.290 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:35:05.290 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:35:05.290 INFO:teuthology.orchestra.run.smithi066.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:35:05.290 INFO:teuthology.orchestra.run.smithi066.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:35:05.290 INFO:teuthology.orchestra.run.smithi066.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:35:05.290 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:05.291 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:35:05.291 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:05.291 INFO:teuthology.orchestra.run.smithi066.stdout:Install 4 Packages 2020-04-28T12:35:05.291 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:05.292 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 467 k 2020-04-28T12:35:05.292 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 1.4 M 2020-04-28T12:35:05.292 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:35:05.355 INFO:teuthology.orchestra.run.smithi066.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 844 kB/s | 48 kB 00:00 2020-04-28T12:35:05.356 INFO:teuthology.orchestra.run.smithi066.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 5.3 MB/s | 356 kB 00:00 2020-04-28T12:35:05.395 INFO:teuthology.orchestra.run.smithi066.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 452 kB/s | 21 kB 00:00 2020-04-28T12:35:05.519 INFO:teuthology.orchestra.run.smithi066.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 183 kB/s | 42 kB 00:00 2020-04-28T12:35:05.520 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:05.520 INFO:teuthology.orchestra.run.smithi066.stdout:Total 2.0 MB/s | 467 kB 00:00 2020-04-28T12:35:05.525 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:35:05.532 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:35:05.532 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:35:05.566 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:35:05.567 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:35:05.751 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:35:06.034 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:35:06.035 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:06.035 INFO:teuthology.orchestra.run.smithi197.stdout: Package Architecture Version Repository Size 2020-04-28T12:35:06.035 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:06.036 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:35:06.036 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:35:06.036 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:06.036 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:35:06.036 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:35:06.037 INFO:teuthology.orchestra.run.smithi197.stdout:Install 1 Package 2020-04-28T12:35:06.037 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:06.037 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 141 k 2020-04-28T12:35:06.037 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 526 k 2020-04-28T12:35:06.037 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:35:06.051 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:35:06.316 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:35:06.318 INFO:teuthology.orchestra.run.smithi197.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 499 kB/s | 141 kB 00:00 2020-04-28T12:35:06.319 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:06.319 INFO:teuthology.orchestra.run.smithi197.stdout:Total 496 kB/s | 141 kB 00:00 2020-04-28T12:35:06.321 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:35:06.335 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:35:06.335 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:35:06.387 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:35:06.388 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:35:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:35:06.655 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:35:06.678 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:35:06.872 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:06.900 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:35:06.901 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:35:06.901 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:35:06.901 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:35:07.081 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:07.161 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:35:07.161 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:07.162 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:07.162 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:35:07.162 INFO:teuthology.orchestra.run.smithi066.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:35:07.162 INFO:teuthology.orchestra.run.smithi066.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:35:07.162 INFO:teuthology.orchestra.run.smithi066.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:35:07.162 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:07.163 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:07.271 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:07.284 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-fuse 2020-04-28T12:35:07.343 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:07.343 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:07.343 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:35:07.343 INFO:teuthology.orchestra.run.smithi197.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:07.343 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:07.343 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:35:07.587 DEBUG:teuthology.parallel:result is None 2020-04-28T12:35:07.749 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:56 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:08.122 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:08.122 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2020-04-28T12:35:08.123 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:08.123 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:35:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:35:08.123 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-04-28T12:35:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:35:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:35:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:08.124 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:35:08.124 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:08.124 INFO:teuthology.orchestra.run.smithi066.stdout:Install 3 Packages 2020-04-28T12:35:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:08.125 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 676 k 2020-04-28T12:35:08.125 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 2.1 M 2020-04-28T12:35:08.125 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:35:08.155 INFO:teuthology.orchestra.run.smithi066.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 82 kB 00:00 2020-04-28T12:35:08.160 INFO:teuthology.orchestra.run.smithi066.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 602 kB/s | 21 kB 00:00 2020-04-28T12:35:08.459 INFO:teuthology.orchestra.run.smithi066.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 1.7 MB/s | 572 kB 00:00 2020-04-28T12:35:08.460 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:08.461 INFO:teuthology.orchestra.run.smithi066.stdout:Total 2.0 MB/s | 676 kB 00:00 2020-04-28T12:35:08.465 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:35:08.488 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:35:08.488 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:35:08.557 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:35:08.558 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:35:08.760 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:35:08.760 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:35:08.760 INFO:teuthology.orchestra.run.smithi066.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:35:08.760 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:09.205 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:35:09.360 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:35:09.675 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:35:09.675 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:35:09.675 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:35:10.349 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:35:10.349 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:10.349 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:10.349 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:35:10.350 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:35:10.350 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:10.350 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:10.648 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:10.662 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install librados-devel 2020-04-28T12:35:11.131 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:00 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:11.544 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:11.545 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:11.545 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-04-28T12:35:11.545 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:11.546 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:35:11.546 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:35:11.546 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:11.546 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:35:11.547 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:11.547 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2020-04-28T12:35:11.547 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:11.547 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 141 k 2020-04-28T12:35:11.548 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 487 k 2020-04-28T12:35:11.548 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:35:12.153 INFO:teuthology.orchestra.run.smithi066.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 232 kB/s | 141 kB 00:00 2020-04-28T12:35:12.154 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:12.155 INFO:teuthology.orchestra.run.smithi066.stdout:Total 231 kB/s | 141 kB 00:00 2020-04-28T12:35:12.156 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:35:12.164 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:35:12.165 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:35:12.221 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:35:12.221 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:35:12.341 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:35:12.542 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:12.756 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:13.036 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:13.037 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:13.037 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:13.037 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:13.315 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:13.332 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install libcephfs2 2020-04-28T12:35:13.799 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:02 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:14.054 INFO:teuthology.orchestra.run.smithi066.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:35:14.162 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:14.163 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:35:14.163 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:14.286 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:14.300 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install libcephfs-devel 2020-04-28T12:35:14.765 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:03 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:15.153 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:15.154 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:15.154 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-04-28T12:35:15.154 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:15.154 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:35:15.155 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:35:15.155 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:15.155 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:35:15.155 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:15.155 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2020-04-28T12:35:15.155 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:15.157 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 21 k 2020-04-28T12:35:15.157 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 76 k 2020-04-28T12:35:15.157 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:35:15.504 INFO:teuthology.orchestra.run.smithi066.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 61 kB/s | 21 kB 00:00 2020-04-28T12:35:15.505 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:15.505 INFO:teuthology.orchestra.run.smithi066.stdout:Total 61 kB/s | 21 kB 00:00 2020-04-28T12:35:15.508 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:35:15.512 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:35:15.512 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:35:15.515 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:35:15.515 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:35:15.594 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:35:15.758 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:15.974 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:16.202 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:16.202 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:16.202 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:16.203 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:16.203 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:16.203 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:16.332 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:16.345 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install librados2 2020-04-28T12:35:16.812 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:05 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:17.096 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:35:17.202 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:17.204 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:35:17.204 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:17.330 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:17.344 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install librbd1 2020-04-28T12:35:17.811 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:06 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:18.087 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:35:18.195 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:18.196 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:35:18.196 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:18.361 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:18.375 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-rados 2020-04-28T12:35:18.838 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:07 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:19.128 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:35:19.235 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:19.237 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:35:19.237 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:19.354 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:19.368 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-rgw 2020-04-28T12:35:19.831 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:08 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:20.095 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:35:20.203 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:20.205 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:35:20.205 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:20.330 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:20.344 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-cephfs 2020-04-28T12:35:20.811 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:09 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:21.078 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:35:21.188 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:21.189 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:35:21.189 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:21.335 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:21.349 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-rbd 2020-04-28T12:35:21.814 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:10 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:22.118 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:35:22.227 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:22.228 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2020-04-28T12:35:22.228 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:22.344 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:22.357 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install rbd-fuse 2020-04-28T12:35:22.823 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:11 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:23.209 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:23.210 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:23.210 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-04-28T12:35:23.210 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:23.211 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:35:23.211 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:35:23.211 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:23.211 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:35:23.211 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:23.211 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2020-04-28T12:35:23.211 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:23.212 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 72 k 2020-04-28T12:35:23.212 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 230 k 2020-04-28T12:35:23.212 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:35:23.444 INFO:teuthology.orchestra.run.smithi066.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 310 kB/s | 72 kB 00:00 2020-04-28T12:35:23.445 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:23.445 INFO:teuthology.orchestra.run.smithi066.stdout:Total 309 kB/s | 72 kB 00:00 2020-04-28T12:35:23.447 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:35:23.459 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:35:23.459 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:35:23.511 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:35:23.511 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:35:23.613 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:35:23.799 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:23.986 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:24.261 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:24.262 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:24.262 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:24.262 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:24.262 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:24.262 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:24.524 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:24.538 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install rbd-mirror 2020-04-28T12:35:25.004 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:14 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:25.378 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:25.378 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:25.378 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2020-04-28T12:35:25.378 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:25.379 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:35:25.379 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:35:25.379 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:25.379 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:35:25.379 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:25.379 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2020-04-28T12:35:25.379 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:25.380 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 2.7 M 2020-04-28T12:35:25.380 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 13 M 2020-04-28T12:35:25.380 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:35:27.896 INFO:teuthology.orchestra.run.smithi066.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 1.1 MB/s | 2.7 MB 00:02 2020-04-28T12:35:27.897 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:27.898 INFO:teuthology.orchestra.run.smithi066.stdout:Total 1.1 MB/s | 2.7 MB 00:02 2020-04-28T12:35:27.900 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:35:27.916 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:35:27.916 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:35:27.983 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:35:27.983 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:35:28.387 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:35:28.608 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:28.960 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:29.209 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:29.210 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:29.210 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:29.210 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:29.210 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:29.210 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:29.534 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:29.549 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install rbd-nbd 2020-04-28T12:35:30.020 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:02:19 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:35:30.395 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-04-28T12:35:30.396 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:30.396 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2020-04-28T12:35:30.396 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:30.397 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-04-28T12:35:30.397 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:35:30.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:30.397 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-04-28T12:35:30.397 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2020-04-28T12:35:30.397 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2020-04-28T12:35:30.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:30.398 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 141 k 2020-04-28T12:35:30.398 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 526 k 2020-04-28T12:35:30.398 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-04-28T12:35:30.665 INFO:teuthology.orchestra.run.smithi066.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 527 kB/s | 141 kB 00:00 2020-04-28T12:35:30.666 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:35:30.666 INFO:teuthology.orchestra.run.smithi066.stdout:Total 525 kB/s | 141 kB 00:00 2020-04-28T12:35:30.668 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-04-28T12:35:30.680 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-04-28T12:35:30.680 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-04-28T12:35:30.732 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-04-28T12:35:30.733 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-04-28T12:35:30.863 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-04-28T12:35:31.065 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:31.550 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:35:31.551 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:31.551 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-04-28T12:35:31.551 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:35:31.551 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:31.551 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-04-28T12:35:31.836 DEBUG:teuthology.parallel:result is None 2020-04-28T12:35:31.837 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:31.853 INFO:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2020-04-28T12:35:31.936 INFO:teuthology.orchestra.run.smithi197.stdout:CentOS 2020-04-28T12:35:31.937 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:35:31.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:35:32.176 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:32.193 INFO:teuthology.orchestra.run.smithi197:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:35:32.253 INFO:teuthology.orchestra.run.smithi197.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:35:32.254 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:35:32.254 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:35:32.255 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:32.269 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-04-28T12:35:32.352 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS 2020-04-28T12:35:32.354 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:35:32.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:35:32.601 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:32.615 INFO:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:35:32.674 INFO:teuthology.orchestra.run.smithi066.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:35:32.674 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:35:32.674 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:35:32.675 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-28T12:35:32.675 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:32.691 INFO:teuthology.orchestra.run.smithi197:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:35:32.764 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:32.779 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:35:32.851 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-28T12:35:32.851 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:32.867 INFO:teuthology.orchestra.run.smithi197:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:35:32.940 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:32.995 INFO:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:35:33.064 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:33.079 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:35:33.151 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:33.205 INFO:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:35:33.275 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-28T12:35:33.275 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:33.290 INFO:teuthology.orchestra.run.smithi197:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:35:33.376 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:33.431 INFO:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:35:33.498 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:33.512 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:35:33.597 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:33.652 INFO:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:35:33.722 INFO:teuthology.run_tasks:Running task ceph... 2020-04-28T12:35:33.791 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-28T12:35:33.791 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:33.805 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2020-04-28T12:35:33.847 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:33.863 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 777 /var/log/ceph 2020-04-28T12:35:33.932 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-28T12:35:33.932 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:33.946 INFO:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:35:33.988 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.002 INFO:teuthology.orchestra.run.smithi197:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:35:34.071 INFO:tasks.ceph:Creating extra log directories... 2020-04-28T12:35:34.071 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:34.085 INFO:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:35:34.127 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.141 INFO:teuthology.orchestra.run.smithi197:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:35:34.210 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-28T12:35:34.210 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999, 'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 20, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}} 2020-04-28T12:35:34.210 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_octopus/qa', 'sleep_before_teardown': 0, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.18556', 'owner': 'scheduled_teuthology@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi197.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+T8kyN13TOWfFVuIUIYnyZcmckjN1tfhlWdIftL6OUteKX5vGofnUhlZVnHf8PR9A1cWRaelhxDmAcyH8+182TLEw9Bd43TEHzBEkwVGathgnOHcHGUPELbgjVGtYVllMEuI4Jg62VpT3T3Qbt5yadiPB2E3sIwg0UQDHP30gn6t4JsMgHPZ8NmTfDYs+Mc5LiTc6cD+3gGhNAG6ZWlswYXhlXJUDt8p06IRhtT60Ot6kwWzCn6vkLjYI8o8AS9C4pPE+fShosMSkjpdJIYQixHdWgw8d1KH1UbVyKxO5BOjbhBMyhofEx2ugLCSd0/+YqdWX3nddYQFqBqPOzGlrKen3qHfpMVViyROcHdOyuu6J6S3RyrIw6N2N85GpY6qEuSgZb1F2ppu2QNG9rjffQJkq1VBpod3cXIZNX5kt3775lwYegLXJDsyp/bs7Jip3KJM7h4ZyGJ297e7+BL8eJREhkNi8eu8ahOIY/27bvnoL1x0foqZ3BjhxN9WGrZ0=', 'smithi066.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJQL1eUayMgmovgCa+XVbg4LBequhqNmYDlWXj9IoMGRCJLrB40hTZhGCvI7g50CecpGqlv4hZn3Bi8wExU/U5mww9ZBoXyURKNv0fo3r/wsNbkFX+FSWQkoyLIBZQonAZcsDf4fPUkZKPkYYrjpygy6gI+qqyBKweWmLyIPloTOT77yzVxoK4qbStLTW6+QObT/6fkBFBwrK1faqGxblPEtOjomzCJ94DO2Pe0W4dey8D7uSJsjDv5huY3r6erIrs4k7O7fzmKIMe0eN6YzVixsDPTdkvh9B08tUP5lV29iboWPsCZ3/saqWYhnw7GfLg9me8EI9DRiDLaE8JBmXLRoij7wYGhxvDqvft3Cm5wu3DbhmCz267QzZ44hN+3NZkwjPqZS6E+tEp9VahlX9xakJYRQQGHvWbYVEe50gfWv+OTStiPzMh6mq/5fSRwWaKXZh4jyKVHgv8uBaidPMfoCC+6mK9Uyc7+5J3atSRaGv9f/dSmbRFpOrPTVVWYyk='}, 'verbose': True, 'job_id': '4989993', 'tube': 'smithi', 'suite_branch': 'octopus', 'priority': 1000, 'os_version': '8.0', 'first_in_suite': False, 'branch': 'octopus', 'suite': 'rgw', 'email': 'ceph-qa@ceph.io', 'archive_path': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4989993', 'description': 'rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'py2', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'name': 'teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'overrides': {'s3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'filestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd sloppy crc': True, 'osd objectstore': 'filestore'}}}, 'rgw': {'frontend': 'civetweb', 'ec-data-pool': True, 'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}, 'storage classes': 'LUKEWARM, FROZEN', 'compression type': 'random'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'branch': 'octopus'}, 'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999, 'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 20, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}, 'fs': 'xfs', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}, 'openssl_keys': {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}}, 'install': {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}}, 'admin_socket': {'branch': 'octopus'}}, 'os_type': 'centos', 'suite_sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:35:34.211 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:34.224 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:35:34.267 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.280 INFO:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:35:34.334 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:34.348 INFO:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:35:34.390 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.404 INFO:teuthology.orchestra.run.smithi197:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:35:34.532 DEBUG:teuthology.orchestra.remote:smithi197:/scratch_devs is 72B 2020-04-28T12:35:34.580 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:35:34.580 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.593 INFO:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:35:34.646 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:35:34.646 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:34.647 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 66961 Links: 1 2020-04-28T12:35:34.647 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:34.647 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:34.647 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2020-04-28 12:35:04.045192695 +0000 2020-04-28T12:35:34.647 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2020-04-28 12:32:50.401246391 +0000 2020-04-28T12:35:34.647 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2020-04-28 12:32:50.401246391 +0000 2020-04-28T12:35:34.647 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2020-04-28T12:35:34.659 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2020-04-28T12:35:34.659 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2020-04-28T12:35:34.660 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000217899 s, 2.3 MB/s 2020-04-28T12:35:34.662 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.716 INFO:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:35:34.770 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:35:34.770 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:34.770 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 65939 Links: 1 2020-04-28T12:35:34.770 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:34.771 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:34.771 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2020-04-28 12:35:04.045192695 +0000 2020-04-28T12:35:34.771 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2020-04-28 12:32:50.788237017 +0000 2020-04-28T12:35:34.771 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2020-04-28 12:32:50.788237017 +0000 2020-04-28T12:35:34.771 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2020-04-28T12:35:34.783 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2020-04-28T12:35:34.783 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2020-04-28T12:35:34.783 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000203613 s, 2.5 MB/s 2020-04-28T12:35:34.785 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.838 INFO:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:35:34.891 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:35:34.892 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:34.892 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 64042 Links: 1 2020-04-28T12:35:34.892 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:34.892 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:34.892 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2020-04-28 12:35:04.045192695 +0000 2020-04-28T12:35:34.892 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2020-04-28 12:32:51.127228806 +0000 2020-04-28T12:35:34.893 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2020-04-28 12:32:51.127228806 +0000 2020-04-28T12:35:34.893 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2020-04-28T12:35:34.905 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2020-04-28T12:35:34.905 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2020-04-28T12:35:34.905 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.00021013 s, 2.4 MB/s 2020-04-28T12:35:34.908 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:34.962 INFO:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:35:35.015 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:35:35.015 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:35.015 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 62097 Links: 1 2020-04-28T12:35:35.016 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:35.016 INFO:teuthology.orchestra.run.smithi197.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:35.016 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2020-04-28 12:35:04.045192695 +0000 2020-04-28T12:35:35.016 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2020-04-28 12:32:51.474220401 +0000 2020-04-28T12:35:35.016 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2020-04-28 12:32:51.474220401 +0000 2020-04-28T12:35:35.016 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2020-04-28T12:35:35.028 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2020-04-28T12:35:35.029 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2020-04-28T12:35:35.029 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000199993 s, 2.6 MB/s 2020-04-28T12:35:35.031 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:35.062 DEBUG:teuthology.orchestra.remote:smithi066:/scratch_devs is 72B 2020-04-28T12:35:35.110 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:35:35.110 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:35.124 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:35:35.179 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:35:35.180 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:35.180 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 63907 Links: 1 2020-04-28T12:35:35.180 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:35.180 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:35.180 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-04-28 12:35:28.788017691 +0000 2020-04-28T12:35:35.180 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-04-28 12:32:51.097549138 +0000 2020-04-28T12:35:35.181 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-04-28 12:32:51.097549138 +0000 2020-04-28T12:35:35.181 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-04-28T12:35:35.197 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-04-28T12:35:35.197 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-04-28T12:35:35.197 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000198244 s, 2.6 MB/s 2020-04-28T12:35:35.200 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:35.254 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:35:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:35:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:35.309 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 65700 Links: 1 2020-04-28T12:35:35.309 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:35.309 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:35.310 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-04-28 12:35:28.788017691 +0000 2020-04-28T12:35:35.310 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-04-28 12:32:51.446546655 +0000 2020-04-28T12:35:35.310 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-04-28 12:32:51.446546655 +0000 2020-04-28T12:35:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-04-28T12:35:35.325 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-04-28T12:35:35.325 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-04-28T12:35:35.325 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000197332 s, 2.6 MB/s 2020-04-28T12:35:35.328 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:35.382 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:35:35.436 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:35:35.436 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:35.437 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 63026 Links: 1 2020-04-28T12:35:35.437 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:35.437 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:35.437 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-04-28 12:35:28.789017683 +0000 2020-04-28T12:35:35.437 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-04-28 12:32:51.832543910 +0000 2020-04-28T12:35:35.437 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-04-28 12:32:51.832543910 +0000 2020-04-28T12:35:35.438 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-04-28T12:35:35.453 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-04-28T12:35:35.453 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-04-28T12:35:35.453 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000196023 s, 2.6 MB/s 2020-04-28T12:35:35.456 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:35.510 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:35:35.565 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:35:35.566 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:35:35.566 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 67715 Links: 1 2020-04-28T12:35:35.566 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:35:35.566 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:35:35.566 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-04-28 12:35:28.789017683 +0000 2020-04-28T12:35:35.566 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-04-28 12:32:52.199541299 +0000 2020-04-28T12:35:35.567 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-04-28 12:32:52.199541299 +0000 2020-04-28T12:35:35.567 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-04-28T12:35:35.581 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-04-28T12:35:35.581 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-04-28T12:35:35.581 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000207016 s, 2.5 MB/s 2020-04-28T12:35:35.583 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:35.584 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi197.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:35:35.584 INFO:tasks.ceph:Generating config... 2020-04-28T12:35:35.585 INFO:tasks.ceph:[mgr] debug ms = 1 2020-04-28T12:35:35.585 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-04-28T12:35:35.585 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2020-04-28T12:35:35.585 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-04-28T12:35:35.586 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1999 2020-04-28T12:35:35.586 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2020-04-28T12:35:35.586 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2020-04-28T12:35:35.586 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2020-04-28T12:35:35.586 INFO:tasks.ceph:[osd] debug ms = 20 2020-04-28T12:35:35.586 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-28T12:35:35.586 INFO:tasks.ceph:[osd] osd fast shutdown = False 2020-04-28T12:35:35.586 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-28T12:35:35.587 INFO:tasks.ceph:[osd] osd objectstore = filestore 2020-04-28T12:35:35.587 INFO:tasks.ceph:[osd] osd sloppy crc = True 2020-04-28T12:35:35.587 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-28T12:35:35.587 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-04-28T12:35:35.587 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-28T12:35:35.588 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-28T12:35:35.588 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2020-04-28T12:35:35.588 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-28T12:35:35.588 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2020-04-28T12:35:35.588 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:35:35.589 INFO:tasks.ceph:[client] debug rgw = 20 2020-04-28T12:35:35.589 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2020-04-28T12:35:35.589 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2020-04-28T12:35:35.589 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2020-04-28T12:35:35.589 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2020-04-28T12:35:35.589 INFO:tasks.ceph:Setting up mon.a... 2020-04-28T12:35:35.590 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:35.603 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-28T12:35:35.702 INFO:teuthology.orchestra.run.smithi197.stdout:creating /etc/ceph/ceph.keyring 2020-04-28T12:35:35.704 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:35.718 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-28T12:35:35.798 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:35.852 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:35:35.918 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.197'), ('mon.c', '[v2:172.21.15.197:3301,v1:172.21.15.197:6790]'), ('mon.b', '172.21.15.66')] 2020-04-28T12:35:35.918 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:35.971 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.197 --addv c '[v2:172.21.15.197:3301,v1:172.21.15.197:6790]' --add b 172.21.15.66 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:36.048 INFO:teuthology.orchestra.run.smithi197.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:36.048 INFO:teuthology.orchestra.run.smithi197.stdout:monmaptool: generated fsid f9c8a2f0-dbb1-4a44-842d-48014855150b 2020-04-28T12:35:36.048 INFO:teuthology.orchestra.run.smithi197.stdout:epoch 0 2020-04-28T12:35:36.049 INFO:teuthology.orchestra.run.smithi197.stdout:fsid f9c8a2f0-dbb1-4a44-842d-48014855150b 2020-04-28T12:35:36.049 INFO:teuthology.orchestra.run.smithi197.stdout:last_changed 2020-04-28T12:35:36.045289+0000 2020-04-28T12:35:36.049 INFO:teuthology.orchestra.run.smithi197.stdout:created 2020-04-28T12:35:36.045289+0000 2020-04-28T12:35:36.049 INFO:teuthology.orchestra.run.smithi197.stdout:min_mon_release 0 (unknown) 2020-04-28T12:35:36.049 INFO:teuthology.orchestra.run.smithi197.stdout:0: [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] mon.a 2020-04-28T12:35:36.049 INFO:teuthology.orchestra.run.smithi197.stdout:1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2020-04-28T12:35:36.050 INFO:teuthology.orchestra.run.smithi197.stdout:2: [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] mon.c 2020-04-28T12:35:36.050 INFO:teuthology.orchestra.run.smithi197.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-28T12:35:36.051 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f9c8a2f0-dbb1-4a44-842d-48014855150b... 2020-04-28T12:35:36.052 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:36.066 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:35:36.108 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:36.121 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:35:36.170 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2020-04-28T12:35:36.170 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2020-04-28T12:35:36.170 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:35:36.170 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2020-04-28T12:35:36.171 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.171 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2020-04-28T12:35:36.171 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.171 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2020-04-28T12:35:36.171 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.171 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2020-04-28T12:35:36.171 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2020-04-28T12:35:36.172 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.172 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2020-04-28T12:35:36.172 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2020-04-28T12:35:36.172 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.172 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:35:36.172 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2020-04-28T12:35:36.172 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2020-04-28T12:35:36.173 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:35:36.174 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:35:36.174 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2020-04-28T12:35:36.174 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:35:36.174 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2020-04-28T12:35:36.174 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:35:36.174 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:35:36.174 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.175 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:35:36.175 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.175 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2020-04-28T12:35:36.175 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.175 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2020-04-28T12:35:36.175 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.175 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2020-04-28T12:35:36.178 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2020-04-28T12:35:36.178 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.197,[v2:172.21.15.197:3301,v1:172.21.15.197:6790],172.21.15.66" 2020-04-28T12:35:36.178 INFO:teuthology.orchestra.run.smithi066.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:35:36.179 INFO:teuthology.orchestra.run.smithi066.stdout: mon client directed command retry = 5 2020-04-28T12:35:36.179 INFO:teuthology.orchestra.run.smithi066.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:35:36.179 INFO:teuthology.orchestra.run.smithi066.stdout: osd heartbeat grace = 40 2020-04-28T12:35:36.179 INFO:teuthology.orchestra.run.smithi066.stdout: ms inject socket failures = 5000 2020-04-28T12:35:36.179 INFO:teuthology.orchestra.run.smithi066.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:35:36.179 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = f9c8a2f0-dbb1-4a44-842d-48014855150b 2020-04-28T12:35:36.180 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.180 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2020-04-28T12:35:36.180 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2020-04-28T12:35:36.180 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.180 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2020-04-28T12:35:36.180 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2020-04-28T12:35:36.181 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.181 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2020-04-28T12:35:36.181 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2020-04-28T12:35:36.181 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.181 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2020-04-28T12:35:36.181 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2020-04-28T12:35:36.181 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2020-04-28T12:35:36.182 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.182 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2020-04-28T12:35:36.182 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2020-04-28T12:35:36.182 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.182 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:35:36.182 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.182 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2020-04-28T12:35:36.183 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2020-04-28T12:35:36.184 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 20 2020-04-28T12:35:36.184 INFO:teuthology.orchestra.run.smithi066.stdout: debug journal = 20 2020-04-28T12:35:36.184 INFO:teuthology.orchestra.run.smithi066.stdout: osd fast shutdown = False 2020-04-28T12:35:36.184 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 25 2020-04-28T12:35:36.184 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = filestore 2020-04-28T12:35:36.184 INFO:teuthology.orchestra.run.smithi066.stdout: osd sloppy crc = True 2020-04-28T12:35:36.184 INFO:teuthology.orchestra.run.smithi066.stdout: debug filestore = 20 2020-04-28T12:35:36.185 INFO:teuthology.orchestra.run.smithi066.stdout: osd shutdown pgref assert = True 2020-04-28T12:35:36.185 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.185 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2020-04-28T12:35:36.185 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-04-28T12:35:36.185 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2020-04-28T12:35:36.185 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-04-28T12:35:36.185 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-04-28T12:35:36.186 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:35:36.186 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:35:36.186 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2020-04-28T12:35:36.186 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.186 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2020-04-28T12:35:36.186 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-04-28T12:35:36.187 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-04-28T12:35:36.187 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2020-04-28T12:35:36.187 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-04-28T12:35:36.187 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2020-04-28T12:35:36.187 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2020-04-28T12:35:36.188 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:35:36.188 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2020-04-28T12:35:36.188 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2020-04-28T12:35:36.188 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:35:36.188 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd crush smoke test = False 2020-04-28T12:35:36.189 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-04-28T12:35:36.189 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2020-04-28T12:35:36.189 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2020-04-28T12:35:36.189 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2020-04-28T12:35:36.189 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2020-04-28T12:35:36.189 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:35:36.189 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:35:36.190 INFO:teuthology.orchestra.run.smithi066.stdout: rgw crypt require ssl = False 2020-04-28T12:35:36.190 INFO:teuthology.orchestra.run.smithi066.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:35:36.190 INFO:teuthology.orchestra.run.smithi066.stdout: debug rgw = 20 2020-04-28T12:35:36.190 INFO:teuthology.orchestra.run.smithi066.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:35:36.190 INFO:teuthology.orchestra.run.smithi066.stdout: rgw max chunk size = 4194304 2020-04-28T12:35:36.190 INFO:teuthology.orchestra.run.smithi066.stdout: rgw lc debug interval = 10 2020-04-28T12:35:36.190 INFO:teuthology.orchestra.run.smithi066.stdout: rgw obj stripe size = 6291456 2020-04-28T12:35:36.191 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2020-04-28T12:35:36.191 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2020-04-28T12:35:36.191 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2020-04-28T12:35:36.213 INFO:teuthology.orchestra.run.smithi197.stdout:[global] 2020-04-28T12:35:36.213 INFO:teuthology.orchestra.run.smithi197.stdout: chdir = "" 2020-04-28T12:35:36.213 INFO:teuthology.orchestra.run.smithi197.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:35:36.213 INFO:teuthology.orchestra.run.smithi197.stdout: auth supported = cephx 2020-04-28T12:35:36.213 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.214 INFO:teuthology.orchestra.run.smithi197.stdout: filestore xattr use omap = true 2020-04-28T12:35:36.214 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.214 INFO:teuthology.orchestra.run.smithi197.stdout: mon clock drift allowed = 1.000 2020-04-28T12:35:36.214 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.214 INFO:teuthology.orchestra.run.smithi197.stdout: osd crush chooseleaf type = 0 2020-04-28T12:35:36.214 INFO:teuthology.orchestra.run.smithi197.stdout: auth debug = true 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on old message = true 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on bug = true 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: mon pg warn max object skew = 0 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.215 INFO:teuthology.orchestra.run.smithi197.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:35:36.216 INFO:teuthology.orchestra.run.smithi197.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:35:36.216 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.216 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default size = 2 2020-04-28T12:35:36.216 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.216 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow primary affinity = true 2020-04-28T12:35:36.216 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow pg remap = true 2020-04-28T12:35:36.216 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:35:36.217 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:35:36.217 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on no sortbitwise = false 2020-04-28T12:35:36.217 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:35:36.217 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on too few osds = false 2020-04-28T12:35:36.217 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:35:36.217 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:35:36.217 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.218 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:35:36.218 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.218 INFO:teuthology.orchestra.run.smithi197.stdout: osd default data pool replay window = 5 2020-04-28T12:35:36.218 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.218 INFO:teuthology.orchestra.run.smithi197.stdout: mon allow pool delete = true 2020-04-28T12:35:36.219 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.219 INFO:teuthology.orchestra.run.smithi197.stdout: mon cluster log file level = debug 2020-04-28T12:35:36.219 INFO:teuthology.orchestra.run.smithi197.stdout: debug asserts on shutdown = true 2020-04-28T12:35:36.219 INFO:teuthology.orchestra.run.smithi197.stdout: mon host = "172.21.15.197,[v2:172.21.15.197:3301,v1:172.21.15.197:6790],172.21.15.66" 2020-04-28T12:35:36.219 INFO:teuthology.orchestra.run.smithi197.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:35:36.220 INFO:teuthology.orchestra.run.smithi197.stdout: mon client directed command retry = 5 2020-04-28T12:35:36.220 INFO:teuthology.orchestra.run.smithi197.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:35:36.220 INFO:teuthology.orchestra.run.smithi197.stdout: osd heartbeat grace = 40 2020-04-28T12:35:36.220 INFO:teuthology.orchestra.run.smithi197.stdout: ms inject socket failures = 5000 2020-04-28T12:35:36.220 INFO:teuthology.orchestra.run.smithi197.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:35:36.220 INFO:teuthology.orchestra.run.smithi197.stdout: fsid = f9c8a2f0-dbb1-4a44-842d-48014855150b 2020-04-28T12:35:36.220 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout:[osd] 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout: osd journal size = 100 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub load threshold = 5.0 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub max interval = 600 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout: osd recover clone overlap = true 2020-04-28T12:35:36.221 INFO:teuthology.orchestra.run.smithi197.stdout: osd recovery max chunk = 1048576 2020-04-28T12:35:36.222 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.222 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug shutdown = true 2020-04-28T12:35:36.222 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug op order = true 2020-04-28T12:35:36.222 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug verify stray on activate = true 2020-04-28T12:35:36.222 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.222 INFO:teuthology.orchestra.run.smithi197.stdout: osd open classes on start = true 2020-04-28T12:35:36.222 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug pg log writeout = true 2020-04-28T12:35:36.223 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.223 INFO:teuthology.orchestra.run.smithi197.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:35:36.223 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.223 INFO:teuthology.orchestra.run.smithi197.stdout: osd map max advance = 10 2020-04-28T12:35:36.223 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.223 INFO:teuthology.orchestra.run.smithi197.stdout: journal zero on create = true 2020-04-28T12:35:36.223 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: filestore apply finisher threads = 3 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: bdev debug aio = true 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug misdirected ops = true 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 20 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: debug journal = 20 2020-04-28T12:35:36.224 INFO:teuthology.orchestra.run.smithi197.stdout: osd fast shutdown = False 2020-04-28T12:35:36.225 INFO:teuthology.orchestra.run.smithi197.stdout: debug osd = 25 2020-04-28T12:35:36.225 INFO:teuthology.orchestra.run.smithi197.stdout: osd objectstore = filestore 2020-04-28T12:35:36.225 INFO:teuthology.orchestra.run.smithi197.stdout: osd sloppy crc = True 2020-04-28T12:35:36.225 INFO:teuthology.orchestra.run.smithi197.stdout: debug filestore = 20 2020-04-28T12:35:36.225 INFO:teuthology.orchestra.run.smithi197.stdout: osd shutdown pgref assert = True 2020-04-28T12:35:36.225 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.225 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr] 2020-04-28T12:35:36.226 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2020-04-28T12:35:36.226 INFO:teuthology.orchestra.run.smithi197.stdout: debug mgr = 20 2020-04-28T12:35:36.226 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2020-04-28T12:35:36.226 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2020-04-28T12:35:36.226 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:35:36.226 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:35:36.226 INFO:teuthology.orchestra.run.smithi197.stdout: mgr/telemetry/nag = false 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout:[mon] 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout: debug paxos = 20 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout: mon data avail warn = 5 2020-04-28T12:35:36.227 INFO:teuthology.orchestra.run.smithi197.stdout: mon mgr mkfs grace = 240 2020-04-28T12:35:36.228 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:35:36.228 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd reporter subtree level = osd 2020-04-28T12:35:36.228 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd prime pg temp = true 2020-04-28T12:35:36.228 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:35:36.228 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd crush smoke test = False 2020-04-28T12:35:36.228 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:35:36.228 INFO:teuthology.orchestra.run.smithi197.stdout:[client] 2020-04-28T12:35:36.229 INFO:teuthology.orchestra.run.smithi197.stdout: rgw cache enabled = true 2020-04-28T12:35:36.229 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable ops log = true 2020-04-28T12:35:36.229 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable usage log = true 2020-04-28T12:35:36.230 INFO:teuthology.orchestra.run.smithi197.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:35:36.230 INFO:teuthology.orchestra.run.smithi197.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:35:36.230 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt require ssl = False 2020-04-28T12:35:36.230 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:35:36.230 INFO:teuthology.orchestra.run.smithi197.stdout: debug rgw = 20 2020-04-28T12:35:36.230 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:35:36.230 INFO:teuthology.orchestra.run.smithi197.stdout: rgw max chunk size = 4194304 2020-04-28T12:35:36.231 INFO:teuthology.orchestra.run.smithi197.stdout: rgw lc debug interval = 10 2020-04-28T12:35:36.231 INFO:teuthology.orchestra.run.smithi197.stdout: rgw obj stripe size = 6291456 2020-04-28T12:35:36.231 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.a] 2020-04-28T12:35:36.231 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.c] 2020-04-28T12:35:36.231 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.b] 2020-04-28T12:35:36.232 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-28T12:35:36.232 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:36.245 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-28T12:35:36.335 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-28T12:35:36.352 DEBUG:teuthology.orchestra.remote:smithi197:/etc/ceph/ceph.keyring is 206B 2020-04-28T12:35:36.449 DEBUG:teuthology.orchestra.remote:smithi197:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-28T12:35:36.496 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi197.front.sepia.ceph.com 2020-04-28T12:35:36.497 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:36.509 INFO:teuthology.orchestra.run.smithi197:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:35:36.606 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:36.659 INFO:teuthology.orchestra.run.smithi197:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:36.743 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:35:36.743 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:36.758 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:35:36.859 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:36.913 INFO:teuthology.orchestra.run.smithi066:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:36.999 INFO:tasks.ceph:Setting up mon nodes... 2020-04-28T12:35:36.999 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-28T12:35:36.999 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:37.012 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:35:37.104 INFO:teuthology.orchestra.run.smithi197.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:35:37.106 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:37.121 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:35:37.244 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:35:37.247 INFO:tasks.ceph:Setting up mds nodes... 2020-04-28T12:35:37.247 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-28T12:35:37.247 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:37.261 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-28T12:35:37.340 INFO:teuthology.orchestra.run.smithi197.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-28T12:35:37.356 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:37.371 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-04-28T12:35:37.454 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-04-28T12:35:37.473 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-28T12:35:37.474 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi197.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:35:37.474 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:37.487 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-28T12:35:37.553 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:37.554 INFO:tasks.ceph:role: osd.0 2020-04-28T12:35:37.554 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi197.front.sepia.ceph.com 2020-04-28T12:35:37.554 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:37.606 INFO:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:35:38.119 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:38.119 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:38.119 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:38.119 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 2020-04-28T12:35:38.119 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:38.119 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:38.120 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:38.120 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:38.120 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:38.120 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:38.121 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2020-04-28T12:35:38.121 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:38.135 INFO:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-28T12:35:38.268 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:38.281 INFO:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-28T12:35:38.353 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:38.406 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-28T12:35:38.473 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:38.473 INFO:tasks.ceph:role: osd.1 2020-04-28T12:35:38.474 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi197.front.sepia.ceph.com 2020-04-28T12:35:38.474 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:38.526 INFO:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:35:39.040 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:39.040 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:39.040 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:39.040 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 2020-04-28T12:35:39.040 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:39.041 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:39.041 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:39.041 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:39.041 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:39.041 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:39.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2020-04-28T12:35:39.042 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:39.056 INFO:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-28T12:35:39.169 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:39.182 INFO:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-28T12:35:39.252 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:39.305 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-28T12:35:39.371 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:39.372 INFO:tasks.ceph:role: osd.2 2020-04-28T12:35:39.372 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi197.front.sepia.ceph.com 2020-04-28T12:35:39.372 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:39.424 INFO:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:35:39.965 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:39.965 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:39.965 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:39.965 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 2020-04-28T12:35:39.966 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:39.966 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:39.966 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:39.966 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:39.966 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:39.966 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:39.967 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2020-04-28T12:35:39.967 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:39.980 INFO:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-28T12:35:40.137 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:40.150 INFO:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-28T12:35:40.220 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:40.273 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-28T12:35:40.340 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:40.340 INFO:tasks.ceph:role: osd.3 2020-04-28T12:35:40.340 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi197.front.sepia.ceph.com 2020-04-28T12:35:40.340 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:40.393 INFO:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:35:40.890 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:40.890 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:40.890 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:40.890 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 2020-04-28T12:35:40.891 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:40.891 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:40.891 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:40.891 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:40.891 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:40.891 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:40.892 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2020-04-28T12:35:40.892 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:40.906 INFO:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-28T12:35:41.006 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:41.020 INFO:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-28T12:35:41.089 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:41.143 INFO:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:41.227 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.223+0000 7fab0c16eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-28T12:35:41.230 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.226+0000 7fab0c16eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-28T12:35:41.242 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.234+0000 7fab0c16eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:41.243 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.236+0000 7fab0c16eec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:41.443 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.433+0000 7fab0c16eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:41.443 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.436+0000 7fab0c16eec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:41.443 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.436+0000 7fab0c16eec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:41.450 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:41.505 INFO:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-28T12:35:41.570 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:41.624 INFO:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:41.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.702+0000 7f2272e21ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-28T12:35:41.707 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.704+0000 7f2272e21ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-28T12:35:41.732 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.728+0000 7f2272e21ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:41.732 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.728+0000 7f2272e21ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:41.939 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.935+0000 7f2272e21ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:41.942 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.938+0000 7f2272e21ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:41.942 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:41.938+0000 7f2272e21ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:41.958 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:42.012 INFO:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-28T12:35:42.079 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:42.133 INFO:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:42.214 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.210+0000 7f460094cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-28T12:35:42.214 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.211+0000 7f460094cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-28T12:35:42.219 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.216+0000 7f460094cec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:42.219 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.216+0000 7f460094cec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:42.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.349+0000 7f460094cec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:42.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.349+0000 7f460094cec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:42.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.349+0000 7f460094cec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:42.359 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:42.413 INFO:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-28T12:35:42.480 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:42.533 INFO:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:42.616 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.612+0000 7f4ca8a18ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-28T12:35:42.616 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.613+0000 7f4ca8a18ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-28T12:35:42.620 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.616+0000 7f4ca8a18ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:42.620 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.617+0000 7f4ca8a18ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:42.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.746+0000 7f4ca8a18ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:42.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.747+0000 7f4ca8a18ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:42.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:35:42.747+0000 7f4ca8a18ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:42.759 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:42.813 INFO:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-28T12:35:42.880 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:42.898 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-28T12:35:42.976 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:42.976 INFO:tasks.ceph:role: osd.4 2020-04-28T12:35:42.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:35:42.977 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:43.032 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:35:43.568 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:43.568 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:43.568 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:43.568 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-04-28T12:35:43.568 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:43.568 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:43.569 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:43.569 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:43.569 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:43.569 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:43.570 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-04-28T12:35:43.570 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:43.587 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-28T12:35:43.739 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:43.754 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-28T12:35:43.831 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:43.886 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-28T12:35:43.961 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:43.961 INFO:tasks.ceph:role: osd.5 2020-04-28T12:35:43.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:35:43.961 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:44.014 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:35:44.534 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:44.535 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:44.535 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:44.535 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-04-28T12:35:44.535 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:44.535 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:44.535 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:44.536 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:44.536 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:44.536 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:44.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-04-28T12:35:44.537 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:44.552 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-28T12:35:44.669 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:44.684 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-28T12:35:44.760 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:44.815 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-28T12:35:44.887 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:44.887 INFO:tasks.ceph:role: osd.6 2020-04-28T12:35:44.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:35:44.888 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:44.941 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:35:45.478 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:45.478 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:45.478 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:45.478 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-04-28T12:35:45.478 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:45.479 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:45.479 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:45.479 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:45.479 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:45.479 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:45.480 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-04-28T12:35:45.480 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:45.495 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-28T12:35:45.658 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:45.672 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-28T12:35:45.746 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:45.800 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-28T12:35:45.871 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:35:45.871 INFO:tasks.ceph:role: osd.7 2020-04-28T12:35:45.872 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:35:45.872 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:45.925 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:35:46.432 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:35:46.432 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:35:46.432 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:35:46.432 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-04-28T12:35:46.433 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:35:46.433 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:35:46.433 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:35:46.433 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:35:46.433 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:35:46.433 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:35:46.434 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-04-28T12:35:46.434 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:46.448 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-28T12:35:46.567 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:46.582 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-28T12:35:46.656 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:46.710 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:46.797 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:46.793+0000 7f8963412ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-28T12:35:46.799 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:46.795+0000 7f8963412ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-28T12:35:46.808 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:46.804+0000 7f8963412ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:46.811 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:46.807+0000 7f8963412ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:47.049 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.045+0000 7f8963412ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:47.050 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.046+0000 7f8963412ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:47.051 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.046+0000 7f8963412ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:47.062 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:47.075 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-28T12:35:47.147 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:47.201 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.284+0000 7fafa204eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-28T12:35:47.289 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.285+0000 7fafa204eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-28T12:35:47.319 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.315+0000 7fafa204eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:47.322 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.318+0000 7fafa204eec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:47.586 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.582+0000 7fafa204eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:47.588 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.584+0000 7fafa204eec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:47.589 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.584+0000 7fafa204eec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:47.608 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:47.621 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-28T12:35:47.693 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:47.746 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:47.840 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.831+0000 7f4bb8fffec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-28T12:35:47.840 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.831+0000 7f4bb8fffec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-28T12:35:47.840 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.835+0000 7f4bb8fffec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:47.840 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.835+0000 7f4bb8fffec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:47.976 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.972+0000 7f4bb8fffec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:47.977 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.972+0000 7f4bb8fffec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:47.977 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:47.972+0000 7f4bb8fffec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:47.983 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:47.996 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-28T12:35:48.068 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:48.122 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:48.205+0000 7f28629d0ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-28T12:35:48.209 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:48.205+0000 7f28629d0ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-28T12:35:48.213 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:48.209+0000 7f28629d0ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:48.214 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:48.209+0000 7f28629d0ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-04-28T12:35:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:48.337+0000 7f28629d0ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:35:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:48.337+0000 7f28629d0ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2020-04-28T12:35:48.337+0000 7f28629d0ec0 -1 journal do_read_entry(4096): bad header magic 2020-04-28T12:35:48.351 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:48.365 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-28T12:35:48.436 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-28T12:35:48.436 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:48.452 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:48.508 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.ipFJ8WSM8R 2020-04-28T12:35:48.509 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:48.563 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.ipFJ8WSM8R 2020-04-28T12:35:48.635 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:48.690 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.ipFJ8WSM8R 2020-04-28T12:35:48.821 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.ipFJ8WSM8R is 56B 2020-04-28T12:35:48.869 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:48.882 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.ipFJ8WSM8R 2020-04-28T12:35:48.937 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:48.991 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:49.046 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.C3ePSkEIZc 2020-04-28T12:35:49.046 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:49.100 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.C3ePSkEIZc 2020-04-28T12:35:49.168 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:49.222 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.C3ePSkEIZc 2020-04-28T12:35:49.346 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.C3ePSkEIZc is 56B 2020-04-28T12:35:49.396 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:49.409 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.C3ePSkEIZc 2020-04-28T12:35:49.462 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:49.514 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:49.568 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.w9qi3KO4xP 2020-04-28T12:35:49.568 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:49.625 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.w9qi3KO4xP 2020-04-28T12:35:49.692 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:49.746 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.w9qi3KO4xP 2020-04-28T12:35:49.870 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.w9qi3KO4xP is 56B 2020-04-28T12:35:49.918 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:49.931 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.w9qi3KO4xP 2020-04-28T12:35:49.984 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:50.037 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:50.091 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.ggKj92LfDe 2020-04-28T12:35:50.091 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:50.144 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.ggKj92LfDe 2020-04-28T12:35:50.211 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:50.265 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.ggKj92LfDe 2020-04-28T12:35:50.394 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.ggKj92LfDe is 56B 2020-04-28T12:35:50.443 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:50.456 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.ggKj92LfDe 2020-04-28T12:35:50.509 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:50.562 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:50.619 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.eSSJqx033A 2020-04-28T12:35:50.620 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:50.672 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.eSSJqx033A 2020-04-28T12:35:50.739 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:50.793 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.eSSJqx033A 2020-04-28T12:35:50.923 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.eSSJqx033A is 56B 2020-04-28T12:35:50.987 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:51.000 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.eSSJqx033A 2020-04-28T12:35:51.053 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:51.070 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:35:51.127 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.fRomBpTd9l 2020-04-28T12:35:51.128 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:51.184 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.fRomBpTd9l 2020-04-28T12:35:51.260 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:51.315 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.fRomBpTd9l 2020-04-28T12:35:51.449 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.fRomBpTd9l is 56B 2020-04-28T12:35:51.499 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:51.514 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.fRomBpTd9l 2020-04-28T12:35:51.578 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:51.633 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:35:51.689 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.uiitJWXZjp 2020-04-28T12:35:51.689 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:51.744 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.uiitJWXZjp 2020-04-28T12:35:51.816 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:51.876 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.uiitJWXZjp 2020-04-28T12:35:52.006 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.uiitJWXZjp is 56B 2020-04-28T12:35:52.054 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.067 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.uiitJWXZjp 2020-04-28T12:35:52.121 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.175 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:35:52.230 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.ZsKatpUlNt 2020-04-28T12:35:52.230 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.283 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.ZsKatpUlNt 2020-04-28T12:35:52.355 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.408 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.ZsKatpUlNt 2020-04-28T12:35:52.536 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.ZsKatpUlNt is 56B 2020-04-28T12:35:52.584 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.597 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.ZsKatpUlNt 2020-04-28T12:35:52.651 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.704 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:35:52.758 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.LWBQCyboLK 2020-04-28T12:35:52.758 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.811 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.LWBQCyboLK 2020-04-28T12:35:52.882 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:52.935 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.LWBQCyboLK 2020-04-28T12:35:53.064 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.LWBQCyboLK is 56B 2020-04-28T12:35:53.111 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:53.127 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.LWBQCyboLK 2020-04-28T12:35:53.178 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:53.231 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:35:53.285 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.kGe7qIqTrE 2020-04-28T12:35:53.285 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:53.339 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.kGe7qIqTrE 2020-04-28T12:35:53.410 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:53.463 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.kGe7qIqTrE 2020-04-28T12:35:53.591 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.kGe7qIqTrE is 56B 2020-04-28T12:35:53.639 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:53.653 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.kGe7qIqTrE 2020-04-28T12:35:53.725 DEBUG:teuthology.orchestra.remote:smithi197:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-28T12:35:53.790 DEBUG:teuthology.orchestra.remote:smithi066:/etc/ceph/ceph.client.1.keyring is 59B 2020-04-28T12:35:53.845 INFO:tasks.ceph:Adding keys to all mons... 2020-04-28T12:35:53.845 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:53.858 INFO:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:35:53.900 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:53.916 INFO:teuthology.orchestra.run.smithi197:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:35:53.959 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2020-04-28T12:35:53.959 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAZI6hefacRBhAAu3J0diDX/EjSAbiFbHTVAw== 2020-04-28T12:35:53.959 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2020-04-28T12:35:53.959 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAdI6he3Y9aDRAAh73ZbGg+NFgKCjBsiFopfQ== 2020-04-28T12:35:53.959 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2020-04-28T12:35:53.959 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAdI6heCH/iKRAAIbxQ35tlq5kAR0fw8JrisA== 2020-04-28T12:35:53.960 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2020-04-28T12:35:53.960 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAeI6he2UmYDBAA67jgCJiJNOpdGgcqiu6sng== 2020-04-28T12:35:53.960 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.3] 2020-04-28T12:35:53.960 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAeI6heKRqOJBAAO9/E6+JvpiEvZrz6erOspw== 2020-04-28T12:35:53.960 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2020-04-28T12:35:53.960 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAZI6henphkDhAAQUtHkYcirkrmMGYhoWqMzA== 2020-04-28T12:35:53.961 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.4] 2020-04-28T12:35:53.961 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAiI6heTSBWLxAAq2ks0lZW04Lcpbq0WKvH3w== 2020-04-28T12:35:53.961 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.5] 2020-04-28T12:35:53.961 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAjI6hezRsLERAARWegMOyNCp2VWnI4WndbCw== 2020-04-28T12:35:53.961 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.6] 2020-04-28T12:35:53.961 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAjI6heOjecMRAAyAGPN3RcSCAtZDZjTWbjhg== 2020-04-28T12:35:53.962 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.7] 2020-04-28T12:35:53.962 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAkI6he5i5JDBAANGiWs/blW6irxcXKFFBK7w== 2020-04-28T12:35:53.962 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2020-04-28T12:35:53.962 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAZI6heWzsjFBAAt538g7hDohN3jrShU2Z5TQ== 2020-04-28T12:35:53.962 INFO:teuthology.orchestra.run.smithi066.stdout:[client.1] 2020-04-28T12:35:53.962 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAZI6heOsjuGhAAKll7hJFtyJbLXm/smyrTsg== 2020-04-28T12:35:53.985 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr.y] 2020-04-28T12:35:53.986 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAZI6hefacRBhAAu3J0diDX/EjSAbiFbHTVAw== 2020-04-28T12:35:53.986 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.0] 2020-04-28T12:35:53.986 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAdI6he3Y9aDRAAh73ZbGg+NFgKCjBsiFopfQ== 2020-04-28T12:35:53.986 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.1] 2020-04-28T12:35:53.986 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAdI6heCH/iKRAAIbxQ35tlq5kAR0fw8JrisA== 2020-04-28T12:35:53.986 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.2] 2020-04-28T12:35:53.987 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAeI6he2UmYDBAA67jgCJiJNOpdGgcqiu6sng== 2020-04-28T12:35:53.987 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.3] 2020-04-28T12:35:53.987 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAeI6heKRqOJBAAO9/E6+JvpiEvZrz6erOspw== 2020-04-28T12:35:53.987 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr.x] 2020-04-28T12:35:53.987 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAZI6henphkDhAAQUtHkYcirkrmMGYhoWqMzA== 2020-04-28T12:35:53.987 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.4] 2020-04-28T12:35:53.987 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAiI6heTSBWLxAAq2ks0lZW04Lcpbq0WKvH3w== 2020-04-28T12:35:53.988 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.5] 2020-04-28T12:35:53.988 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAjI6hezRsLERAARWegMOyNCp2VWnI4WndbCw== 2020-04-28T12:35:53.988 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.6] 2020-04-28T12:35:53.988 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAjI6heOjecMRAAyAGPN3RcSCAtZDZjTWbjhg== 2020-04-28T12:35:53.988 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.7] 2020-04-28T12:35:53.988 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAkI6he5i5JDBAANGiWs/blW6irxcXKFFBK7w== 2020-04-28T12:35:53.988 INFO:teuthology.orchestra.run.smithi197.stdout:[client.0] 2020-04-28T12:35:53.989 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAZI6heWzsjFBAAt538g7hDohN3jrShU2Z5TQ== 2020-04-28T12:35:53.989 INFO:teuthology.orchestra.run.smithi197.stdout:[client.1] 2020-04-28T12:35:53.989 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQAZI6heOsjuGhAAKll7hJFtyJbLXm/smyrTsg== 2020-04-28T12:35:53.990 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:54.018 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:35:54.071 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:54.088 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:35:54.182 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:54.196 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.238 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:54.253 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.343 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:54.357 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.400 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:54.415 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.504 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:54.518 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.560 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:54.574 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.662 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:54.676 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.723 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:54.737 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:54.824 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:54.838 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:35:54.880 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:54.894 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:35:54.981 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:54.995 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.038 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:55.052 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.141 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:55.154 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.197 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:55.210 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.297 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:55.312 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.355 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:55.368 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.455 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:55.469 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.511 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:55.525 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:35:55.613 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:55.627 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:35:55.669 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:55.682 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:35:55.772 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:55.786 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:35:55.828 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:55.842 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:35:55.932 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-28T12:35:55.932 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:55.945 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-28T12:35:56.012 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:56.065 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:35:56.160 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:56.173 INFO:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-28T12:35:56.239 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:56.292 INFO:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-28T12:35:56.358 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:56.411 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:35:56.503 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:56.516 INFO:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-28T12:35:56.583 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:56.600 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-28T12:35:56.675 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:56.731 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:35:56.832 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:56.847 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-28T12:35:56.919 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:56.974 INFO:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:57.016 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.030 INFO:teuthology.orchestra.run.smithi197:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:35:57.084 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-28T12:35:57.084 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-28T12:35:57.084 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.137 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-28T12:35:57.179 INFO:tasks.ceph.mon.a:Started 2020-04-28T12:35:57.180 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-28T12:35:57.180 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.193 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-28T12:35:57.236 INFO:tasks.ceph.mon.c:Started 2020-04-28T12:35:57.236 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-28T12:35:57.236 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:57.250 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-28T12:35:57.292 INFO:tasks.ceph.mon.b:Started 2020-04-28T12:35:57.292 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-28T12:35:57.292 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-28T12:35:57.292 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.307 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-28T12:35:57.350 INFO:tasks.ceph.mgr.y:Started 2020-04-28T12:35:57.350 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-28T12:35:57.350 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:57.364 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-28T12:35:57.406 INFO:tasks.ceph.mgr.x:Started 2020-04-28T12:35:57.406 INFO:tasks.ceph:Setting crush tunables to default 2020-04-28T12:35:57.407 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.421 INFO:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd crush tunables default 2020-04-28T12:35:57.658 INFO:teuthology.orchestra.run.smithi197.stderr:adjusted tunables profile to default 2020-04-28T12:35:57.668 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-28T12:35:57.668 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.681 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:57.735 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.SzYTRUqCo6 2020-04-28T12:35:57.735 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.789 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.SzYTRUqCo6 2020-04-28T12:35:57.856 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:57.910 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.SzYTRUqCo6 2020-04-28T12:35:58.034 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.SzYTRUqCo6 is 37B 2020-04-28T12:35:58.081 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.094 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.SzYTRUqCo6 2020-04-28T12:35:58.148 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.201 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:58.254 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.eLJuDAgNDD 2020-04-28T12:35:58.254 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.307 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.eLJuDAgNDD 2020-04-28T12:35:58.375 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.429 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.eLJuDAgNDD 2020-04-28T12:35:58.563 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.eLJuDAgNDD is 37B 2020-04-28T12:35:58.611 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.624 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.eLJuDAgNDD 2020-04-28T12:35:58.678 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.732 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:58.791 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.E0DrcoUn8m 2020-04-28T12:35:58.791 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.845 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.E0DrcoUn8m 2020-04-28T12:35:58.914 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:58.968 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.E0DrcoUn8m 2020-04-28T12:35:59.091 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.E0DrcoUn8m is 37B 2020-04-28T12:35:59.139 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:59.152 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.E0DrcoUn8m 2020-04-28T12:35:59.206 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:59.259 INFO:teuthology.orchestra.run.smithi197:> mktemp 2020-04-28T12:35:59.313 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.LKO2612PvR 2020-04-28T12:35:59.314 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:59.366 INFO:teuthology.orchestra.run.smithi197:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.LKO2612PvR 2020-04-28T12:35:59.433 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:59.487 INFO:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.LKO2612PvR 2020-04-28T12:35:59.610 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.LKO2612PvR is 37B 2020-04-28T12:35:59.658 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:35:59.671 INFO:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.LKO2612PvR 2020-04-28T12:35:59.726 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:59.739 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:35:59.793 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.z3rvYNkMz6 2020-04-28T12:35:59.794 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:59.848 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.z3rvYNkMz6 2020-04-28T12:35:59.920 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:35:59.974 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.z3rvYNkMz6 2020-04-28T12:36:00.103 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.z3rvYNkMz6 is 37B 2020-04-28T12:36:00.149 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:00.163 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.z3rvYNkMz6 2020-04-28T12:36:00.217 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:00.271 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:36:00.325 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.QV26bwiYV3 2020-04-28T12:36:00.326 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:00.380 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.QV26bwiYV3 2020-04-28T12:36:00.451 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:00.506 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.QV26bwiYV3 2020-04-28T12:36:00.636 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.QV26bwiYV3 is 37B 2020-04-28T12:36:00.686 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:00.700 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.QV26bwiYV3 2020-04-28T12:36:00.754 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:00.807 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:36:00.861 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.ZeNm46JwoT 2020-04-28T12:36:00.861 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:00.914 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.ZeNm46JwoT 2020-04-28T12:36:00.988 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:01.041 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.ZeNm46JwoT 2020-04-28T12:36:01.168 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.ZeNm46JwoT is 37B 2020-04-28T12:36:01.216 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:01.230 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.ZeNm46JwoT 2020-04-28T12:36:01.284 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:01.339 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-04-28T12:36:01.394 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.HWtz1S0IYl 2020-04-28T12:36:01.394 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:01.447 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.HWtz1S0IYl 2020-04-28T12:36:01.525 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:01.579 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.HWtz1S0IYl 2020-04-28T12:36:01.707 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.HWtz1S0IYl is 37B 2020-04-28T12:36:01.754 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:01.767 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.HWtz1S0IYl 2020-04-28T12:36:01.821 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:01.874 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 009d23fe-2af5-4186-ad00-4278d8d26340 0 2020-04-28T12:36:02.205 INFO:teuthology.orchestra.run.smithi066.stdout:0 2020-04-28T12:36:02.217 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:02.231 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new c7da0680-297c-4992-9e48-16d46a916070 1 2020-04-28T12:36:02.564 INFO:teuthology.orchestra.run.smithi066.stdout:1 2020-04-28T12:36:02.576 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:02.590 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 13dfdde0-4c8c-46f2-ba87-595100243246 2 2020-04-28T12:36:02.919 INFO:teuthology.orchestra.run.smithi066.stdout:2 2020-04-28T12:36:02.930 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:02.944 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new f5627cc2-7063-4e07-b0e1-6c89c2b87b4a 3 2020-04-28T12:36:03.274 INFO:teuthology.orchestra.run.smithi066.stdout:3 2020-04-28T12:36:03.286 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:03.300 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new da456463-56d5-4da2-81c3-5b4992ff550a 4 2020-04-28T12:36:03.631 INFO:teuthology.orchestra.run.smithi066.stdout:4 2020-04-28T12:36:03.643 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:03.656 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 0bc2583d-5450-413e-8da8-517062319234 5 2020-04-28T12:36:03.985 INFO:teuthology.orchestra.run.smithi066.stdout:5 2020-04-28T12:36:03.996 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:04.010 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 96b7d461-e0bf-4a0d-993a-010b3d2b704a 6 2020-04-28T12:36:04.335 INFO:teuthology.orchestra.run.smithi066.stdout:6 2020-04-28T12:36:04.347 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:04.361 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new b238c2c1-bfa7-46e7-bf31-120e4d8799fd 7 2020-04-28T12:36:04.694 INFO:teuthology.orchestra.run.smithi066.stdout:7 2020-04-28T12:36:04.706 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-28T12:36:04.706 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:04.723 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-28T12:36:04.766 INFO:tasks.ceph.osd.0:Started 2020-04-28T12:36:04.766 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-28T12:36:04.766 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:04.782 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-28T12:36:04.824 INFO:tasks.ceph.osd.1:Started 2020-04-28T12:36:04.825 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-28T12:36:04.825 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:04.839 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-28T12:36:04.852 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T12:36:04.847+0000 7fbe3f532ec0 -1 Falling back to public interface 2020-04-28T12:36:04.853 INFO:tasks.ceph.osd.2:Started 2020-04-28T12:36:04.854 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-28T12:36:04.854 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:04.863 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T12:36:04.858+0000 7fbe3f532ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:04.863 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T12:36:04.859+0000 7fbe3f532ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:04.863 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T12:36:04.859+0000 7fbe3f532ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:04.869 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T12:36:04.864+0000 7fbe3f532ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-28T12:36:04.876 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-28T12:36:04.917 INFO:tasks.ceph.osd.3:Started 2020-04-28T12:36:04.918 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-28T12:36:04.918 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:04.924 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-04-28T12:36:04.919+0000 7f526a113ec0 -1 Falling back to public interface 2020-04-28T12:36:04.932 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-28T12:36:04.935 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-04-28T12:36:04.930+0000 7f526a113ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:04.935 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-04-28T12:36:04.930+0000 7f526a113ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:04.935 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-04-28T12:36:04.930+0000 7f526a113ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:04.940 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-04-28T12:36:04.936+0000 7f526a113ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-28T12:36:04.960 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:36:04.956+0000 7f1482be5ec0 -1 Falling back to public interface 2020-04-28T12:36:04.973 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:36:04.969+0000 7f1482be5ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:04.974 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:36:04.969+0000 7f1482be5ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:04.974 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:36:04.969+0000 7f1482be5ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:04.974 INFO:tasks.ceph.osd.4:Started 2020-04-28T12:36:04.975 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-28T12:36:04.975 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:04.978 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:36:04.974+0000 7f1482be5ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-28T12:36:04.991 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-28T12:36:04.999 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:36:04.995+0000 7fc408622ec0 -1 Falling back to public interface 2020-04-28T12:36:05.014 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:36:05.009+0000 7fc408622ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:05.014 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:36:05.009+0000 7fc408622ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.015 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:36:05.009+0000 7fc408622ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.018 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:36:05.014+0000 7fc408622ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-28T12:36:05.033 INFO:tasks.ceph.osd.5:Started 2020-04-28T12:36:05.034 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-28T12:36:05.034 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:05.049 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-28T12:36:05.055 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-04-28T12:36:05.050+0000 7fe0d3f29ec0 -1 Falling back to public interface 2020-04-28T12:36:05.056 INFO:tasks.ceph.osd.6:Started 2020-04-28T12:36:05.056 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-28T12:36:05.057 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:05.067 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-04-28T12:36:05.062+0000 7fe0d3f29ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:05.067 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-04-28T12:36:05.062+0000 7fe0d3f29ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.067 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-04-28T12:36:05.062+0000 7fe0d3f29ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.071 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-04-28T12:36:05.067+0000 7fe0d3f29ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-28T12:36:05.082 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-28T12:36:05.118 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:36:05.114+0000 7fddfc92bec0 -1 Falling back to public interface 2020-04-28T12:36:05.120 INFO:tasks.ceph.osd.7:Started 2020-04-28T12:36:05.120 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-28T12:36:05.131 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:36:05.127+0000 7fddfc92bec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:05.131 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:36:05.127+0000 7fddfc92bec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.132 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:36:05.127+0000 7fddfc92bec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.136 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:36:05.132+0000 7fddfc92bec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-28T12:36:05.152 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:36:05.148+0000 7fb43d525ec0 -1 Falling back to public interface 2020-04-28T12:36:05.169 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:36:05.164+0000 7fb43d525ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:05.169 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:36:05.164+0000 7fb43d525ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.169 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:36:05.164+0000 7fb43d525ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.174 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:36:05.170+0000 7fb43d525ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-28T12:36:05.207 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:36:05.203+0000 7f4087812ec0 -1 Falling back to public interface 2020-04-28T12:36:05.227 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:36:05.217+0000 7f4087812ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-04-28T12:36:05.227 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:36:05.218+0000 7f4087812ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.227 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:36:05.218+0000 7f4087812ec0 -1 journal do_read_entry(8192): bad header magic 2020-04-28T12:36:05.228 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:36:05.223+0000 7f4087812ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-28T12:36:05.931 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:05.947 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:36:06.233 INFO:teuthology.misc.health.smithi197.stdout: 2020-04-28T12:36:06.233 INFO:teuthology.misc.health.smithi197.stdout:{"epoch":12,"fsid":"f9c8a2f0-dbb1-4a44-842d-48014855150b","created":"2020-04-28T12:35:57.419498+0000","modified":"2020-04-28T12:36:05.689220+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:36:00.566522+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"009d23fe-2af5-4186-ad00-4278d8d26340","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c7da0680-297c-4992-9e48-16d46a916070","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"13dfdde0-4c8c-46f2-ba87-595100243246","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f5627cc2-7063-4e07-b0e1-6c89c2b87b4a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"da456463-56d5-4da2-81c3-5b4992ff550a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0bc2583d-5450-413e-8da8-517062319234","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"96b7d461-e0bf-4a0d-993a-010b3d2b704a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b238c2c1-bfa7-46e7-bf31-120e4d8799fd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:36:06.244 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-28T12:36:06.704 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-04-28T12:36:06.700+0000 7fe0b6cc9700 -1 osd.4 0 waiting for initial osdmap 2020-04-28T12:36:06.704 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:36:06.700+0000 7f406a5b2700 -1 osd.7 0 waiting for initial osdmap 2020-04-28T12:36:06.706 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T12:36:06.700+0000 7fbe222d2700 -1 osd.0 0 waiting for initial osdmap 2020-04-28T12:36:06.706 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-04-28T12:36:06.700+0000 7f524ceb3700 -1 osd.1 0 waiting for initial osdmap 2020-04-28T12:36:06.706 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:36:06.700+0000 7f1465985700 -1 osd.2 0 waiting for initial osdmap 2020-04-28T12:36:06.707 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:36:06.700+0000 7fc3eb3c2700 -1 osd.3 0 waiting for initial osdmap 2020-04-28T12:36:06.707 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:36:06.701+0000 7fdddf6cb700 -1 osd.5 0 waiting for initial osdmap 2020-04-28T12:36:06.709 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:36:06.705+0000 7fb4202c5700 -1 osd.6 0 waiting for initial osdmap 2020-04-28T12:36:13.051 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:13.071 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:36:13.363 INFO:teuthology.misc.health.smithi197.stdout: 2020-04-28T12:36:13.363 INFO:teuthology.misc.health.smithi197.stdout:{"epoch":16,"fsid":"f9c8a2f0-dbb1-4a44-842d-48014855150b","created":"2020-04-28T12:35:57.419498+0000","modified":"2020-04-28T12:36:09.724915+0000","last_up_change":"2020-04-28T12:36:07.696385+0000","last_in_change":"2020-04-28T12:36:07.696385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:36:00.566522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"009d23fe-2af5-4186-ad00-4278d8d26340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":23194},{"type":"v1","addr":"172.21.15.197:6803","nonce":23194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":23194},{"type":"v1","addr":"172.21.15.197:6805","nonce":23194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":23194},{"type":"v1","addr":"172.21.15.197:6809","nonce":23194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":23194},{"type":"v1","addr":"172.21.15.197:6807","nonce":23194}]},"public_addr":"172.21.15.197:6803/23194","cluster_addr":"172.21.15.197:6805/23194","heartbeat_back_addr":"172.21.15.197:6809/23194","heartbeat_front_addr":"172.21.15.197:6807/23194","state":["exists","up"]},{"osd":1,"uuid":"c7da0680-297c-4992-9e48-16d46a916070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":23338},{"type":"v1","addr":"172.21.15.197:6811","nonce":23338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":23338},{"type":"v1","addr":"172.21.15.197:6813","nonce":23338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":23338},{"type":"v1","addr":"172.21.15.197:6817","nonce":23338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":23338},{"type":"v1","addr":"172.21.15.197:6815","nonce":23338}]},"public_addr":"172.21.15.197:6811/23338","cluster_addr":"172.21.15.197:6813/23338","heartbeat_back_addr":"172.21.15.197:6817/23338","heartbeat_front_addr":"172.21.15.197:6815/23338","state":["exists","up"]},{"osd":2,"uuid":"13dfdde0-4c8c-46f2-ba87-595100243246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":23454},{"type":"v1","addr":"172.21.15.197:6819","nonce":23454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":23454},{"type":"v1","addr":"172.21.15.197:6821","nonce":23454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":23454},{"type":"v1","addr":"172.21.15.197:6825","nonce":23454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":23454},{"type":"v1","addr":"172.21.15.197:6823","nonce":23454}]},"public_addr":"172.21.15.197:6819/23454","cluster_addr":"172.21.15.197:6821/23454","heartbeat_back_addr":"172.21.15.197:6825/23454","heartbeat_front_addr":"172.21.15.197:6823/23454","state":["exists","up"]},{"osd":3,"uuid":"f5627cc2-7063-4e07-b0e1-6c89c2b87b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":23556},{"type":"v1","addr":"172.21.15.197:6827","nonce":23556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":23556},{"type":"v1","addr":"172.21.15.197:6829","nonce":23556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6832","nonce":23556},{"type":"v1","addr":"172.21.15.197:6833","nonce":23556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":23556},{"type":"v1","addr":"172.21.15.197:6831","nonce":23556}]},"public_addr":"172.21.15.197:6827/23556","cluster_addr":"172.21.15.197:6829/23556","heartbeat_back_addr":"172.21.15.197:6833/23556","heartbeat_front_addr":"172.21.15.197:6831/23556","state":["exists","up"]},{"osd":4,"uuid":"da456463-56d5-4da2-81c3-5b4992ff550a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":23098},{"type":"v1","addr":"172.21.15.66:6801","nonce":23098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":23098},{"type":"v1","addr":"172.21.15.66:6803","nonce":23098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":23098},{"type":"v1","addr":"172.21.15.66:6807","nonce":23098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":23098},{"type":"v1","addr":"172.21.15.66:6805","nonce":23098}]},"public_addr":"172.21.15.66:6801/23098","cluster_addr":"172.21.15.66:6803/23098","heartbeat_back_addr":"172.21.15.66:6807/23098","heartbeat_front_addr":"172.21.15.66:6805/23098","state":["exists","up"]},{"osd":5,"uuid":"0bc2583d-5450-413e-8da8-517062319234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":23254},{"type":"v1","addr":"172.21.15.66:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":23254},{"type":"v1","addr":"172.21.15.66:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":23254},{"type":"v1","addr":"172.21.15.66:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":23254},{"type":"v1","addr":"172.21.15.66:6813","nonce":23254}]},"public_addr":"172.21.15.66:6809/23254","cluster_addr":"172.21.15.66:6811/23254","heartbeat_back_addr":"172.21.15.66:6815/23254","heartbeat_front_addr":"172.21.15.66:6813/23254","state":["exists","up"]},{"osd":6,"uuid":"96b7d461-e0bf-4a0d-993a-010b3d2b704a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":23329},{"type":"v1","addr":"172.21.15.66:6817","nonce":23329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":23329},{"type":"v1","addr":"172.21.15.66:6819","nonce":23329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":23329},{"type":"v1","addr":"172.21.15.66:6823","nonce":23329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":23329},{"type":"v1","addr":"172.21.15.66:6821","nonce":23329}]},"public_addr":"172.21.15.66:6817/23329","cluster_addr":"172.21.15.66:6819/23329","heartbeat_back_addr":"172.21.15.66:6823/23329","heartbeat_front_addr":"172.21.15.66:6821/23329","state":["exists","up"]},{"osd":7,"uuid":"b238c2c1-bfa7-46e7-bf31-120e4d8799fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":23472},{"type":"v1","addr":"172.21.15.66:6825","nonce":23472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":23472},{"type":"v1","addr":"172.21.15.66:6827","nonce":23472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":23472},{"type":"v1","addr":"172.21.15.66:6831","nonce":23472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":23472},{"type":"v1","addr":"172.21.15.66:6829","nonce":23472}]},"public_addr":"172.21.15.66:6825/23472","cluster_addr":"172.21.15.66:6827/23472","heartbeat_back_addr":"172.21.15.66:6831/23472","heartbeat_front_addr":"172.21.15.66:6829/23472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.914682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.984284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.005660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.017981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.020554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.170316+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.124245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.192928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:36:13.374 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-28T12:36:13.374 INFO:tasks.ceph:Creating RBD pool 2020-04-28T12:36:13.374 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:13.388 INFO:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-28T12:36:14.403 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'rbd' created 2020-04-28T12:36:14.414 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:14.429 INFO:teuthology.orchestra.run.smithi197:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-28T12:36:15.410 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-28T12:36:15.420 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-28T12:36:15.420 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:15.421 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-28T12:36:15.434 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:36:15.730 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:36:15.731 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":18,"fsid":"f9c8a2f0-dbb1-4a44-842d-48014855150b","created":"2020-04-28T12:35:57.419498+0000","modified":"2020-04-28T12:36:15.392682+0000","last_up_change":"2020-04-28T12:36:07.696385+0000","last_in_change":"2020-04-28T12:36:07.696385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:36:00.566522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:36:13.675163+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"009d23fe-2af5-4186-ad00-4278d8d26340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":23194},{"type":"v1","addr":"172.21.15.197:6803","nonce":23194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":23194},{"type":"v1","addr":"172.21.15.197:6805","nonce":23194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":23194},{"type":"v1","addr":"172.21.15.197:6809","nonce":23194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":23194},{"type":"v1","addr":"172.21.15.197:6807","nonce":23194}]},"public_addr":"172.21.15.197:6803/23194","cluster_addr":"172.21.15.197:6805/23194","heartbeat_back_addr":"172.21.15.197:6809/23194","heartbeat_front_addr":"172.21.15.197:6807/23194","state":["exists","up"]},{"osd":1,"uuid":"c7da0680-297c-4992-9e48-16d46a916070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":23338},{"type":"v1","addr":"172.21.15.197:6811","nonce":23338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":23338},{"type":"v1","addr":"172.21.15.197:6813","nonce":23338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":23338},{"type":"v1","addr":"172.21.15.197:6817","nonce":23338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":23338},{"type":"v1","addr":"172.21.15.197:6815","nonce":23338}]},"public_addr":"172.21.15.197:6811/23338","cluster_addr":"172.21.15.197:6813/23338","heartbeat_back_addr":"172.21.15.197:6817/23338","heartbeat_front_addr":"172.21.15.197:6815/23338","state":["exists","up"]},{"osd":2,"uuid":"13dfdde0-4c8c-46f2-ba87-595100243246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":23454},{"type":"v1","addr":"172.21.15.197:6819","nonce":23454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":23454},{"type":"v1","addr":"172.21.15.197:6821","nonce":23454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":23454},{"type":"v1","addr":"172.21.15.197:6825","nonce":23454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":23454},{"type":"v1","addr":"172.21.15.197:6823","nonce":23454}]},"public_addr":"172.21.15.197:6819/23454","cluster_addr":"172.21.15.197:6821/23454","heartbeat_back_addr":"172.21.15.197:6825/23454","heartbeat_front_addr":"172.21.15.197:6823/23454","state":["exists","up"]},{"osd":3,"uuid":"f5627cc2-7063-4e07-b0e1-6c89c2b87b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":23556},{"type":"v1","addr":"172.21.15.197:6827","nonce":23556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":23556},{"type":"v1","addr":"172.21.15.197:6829","nonce":23556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6832","nonce":23556},{"type":"v1","addr":"172.21.15.197:6833","nonce":23556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":23556},{"type":"v1","addr":"172.21.15.197:6831","nonce":23556}]},"public_addr":"172.21.15.197:6827/23556","cluster_addr":"172.21.15.197:6829/23556","heartbeat_back_addr":"172.21.15.197:6833/23556","heartbeat_front_addr":"172.21.15.197:6831/23556","state":["exists","up"]},{"osd":4,"uuid":"da456463-56d5-4da2-81c3-5b4992ff550a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":23098},{"type":"v1","addr":"172.21.15.66:6801","nonce":23098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":23098},{"type":"v1","addr":"172.21.15.66:6803","nonce":23098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":23098},{"type":"v1","addr":"172.21.15.66:6807","nonce":23098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":23098},{"type":"v1","addr":"172.21.15.66:6805","nonce":23098}]},"public_addr":"172.21.15.66:6801/23098","cluster_addr":"172.21.15.66:6803/23098","heartbeat_back_addr":"172.21.15.66:6807/23098","heartbeat_front_addr":"172.21.15.66:6805/23098","state":["exists","up"]},{"osd":5,"uuid":"0bc2583d-5450-413e-8da8-517062319234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":23254},{"type":"v1","addr":"172.21.15.66:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":23254},{"type":"v1","addr":"172.21.15.66:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":23254},{"type":"v1","addr":"172.21.15.66:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":23254},{"type":"v1","addr":"172.21.15.66:6813","nonce":23254}]},"public_addr":"172.21.15.66:6809/23254","cluster_addr":"172.21.15.66:6811/23254","heartbeat_back_addr":"172.21.15.66:6815/23254","heartbeat_front_addr":"172.21.15.66:6813/23254","state":["exists","up"]},{"osd":6,"uuid":"96b7d461-e0bf-4a0d-993a-010b3d2b704a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":23329},{"type":"v1","addr":"172.21.15.66:6817","nonce":23329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":23329},{"type":"v1","addr":"172.21.15.66:6819","nonce":23329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":23329},{"type":"v1","addr":"172.21.15.66:6823","nonce":23329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":23329},{"type":"v1","addr":"172.21.15.66:6821","nonce":23329}]},"public_addr":"172.21.15.66:6817/23329","cluster_addr":"172.21.15.66:6819/23329","heartbeat_back_addr":"172.21.15.66:6823/23329","heartbeat_front_addr":"172.21.15.66:6821/23329","state":["exists","up"]},{"osd":7,"uuid":"b238c2c1-bfa7-46e7-bf31-120e4d8799fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":23472},{"type":"v1","addr":"172.21.15.66:6825","nonce":23472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":23472},{"type":"v1","addr":"172.21.15.66:6827","nonce":23472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":23472},{"type":"v1","addr":"172.21.15.66:6831","nonce":23472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":23472},{"type":"v1","addr":"172.21.15.66:6829","nonce":23472}]},"public_addr":"172.21.15.66:6825/23472","cluster_addr":"172.21.15.66:6827/23472","heartbeat_back_addr":"172.21.15.66:6831/23472","heartbeat_front_addr":"172.21.15.66:6829/23472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.914682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.984284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.005660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.017981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.020554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.170316+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.124245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.192928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:36:15.743 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:36:00.566522+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:36:13.675163+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-28T12:36:15.743 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:15.757 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-28T12:36:16.053 INFO:teuthology.orchestra.run.smithi197.stdout:pg_num: 1 2020-04-28T12:36:16.066 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:16.079 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-28T12:36:16.373 INFO:teuthology.orchestra.run.smithi197.stdout:pg_num: 8 2020-04-28T12:36:16.390 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-28T12:36:16.390 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-28T12:36:16.390 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:16.404 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-28T12:36:16.739 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:36:16.749 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":4,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":22333},{"type":"v1","addr":"172.21.15.197:6801","nonce":22333}]},"active_addr":"172.21.15.197:6801/22333","active_change":"2020-04-28T12:36:00.549926+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":99720018}]},{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":2638601734}]},{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":466393314}]}]}} 2020-04-28T12:36:16.756 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-28T12:36:16.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-28T12:36:16.757 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:16.770 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:36:17.066 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:36:17.066 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":19,"fsid":"f9c8a2f0-dbb1-4a44-842d-48014855150b","created":"2020-04-28T12:35:57.419498+0000","modified":"2020-04-28T12:36:16.396336+0000","last_up_change":"2020-04-28T12:36:07.696385+0000","last_in_change":"2020-04-28T12:36:07.696385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:36:00.566522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:36:13.675163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"009d23fe-2af5-4186-ad00-4278d8d26340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":23194},{"type":"v1","addr":"172.21.15.197:6803","nonce":23194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":23194},{"type":"v1","addr":"172.21.15.197:6805","nonce":23194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":23194},{"type":"v1","addr":"172.21.15.197:6809","nonce":23194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":23194},{"type":"v1","addr":"172.21.15.197:6807","nonce":23194}]},"public_addr":"172.21.15.197:6803/23194","cluster_addr":"172.21.15.197:6805/23194","heartbeat_back_addr":"172.21.15.197:6809/23194","heartbeat_front_addr":"172.21.15.197:6807/23194","state":["exists","up"]},{"osd":1,"uuid":"c7da0680-297c-4992-9e48-16d46a916070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":23338},{"type":"v1","addr":"172.21.15.197:6811","nonce":23338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":23338},{"type":"v1","addr":"172.21.15.197:6813","nonce":23338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":23338},{"type":"v1","addr":"172.21.15.197:6817","nonce":23338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":23338},{"type":"v1","addr":"172.21.15.197:6815","nonce":23338}]},"public_addr":"172.21.15.197:6811/23338","cluster_addr":"172.21.15.197:6813/23338","heartbeat_back_addr":"172.21.15.197:6817/23338","heartbeat_front_addr":"172.21.15.197:6815/23338","state":["exists","up"]},{"osd":2,"uuid":"13dfdde0-4c8c-46f2-ba87-595100243246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":23454},{"type":"v1","addr":"172.21.15.197:6819","nonce":23454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":23454},{"type":"v1","addr":"172.21.15.197:6821","nonce":23454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":23454},{"type":"v1","addr":"172.21.15.197:6825","nonce":23454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":23454},{"type":"v1","addr":"172.21.15.197:6823","nonce":23454}]},"public_addr":"172.21.15.197:6819/23454","cluster_addr":"172.21.15.197:6821/23454","heartbeat_back_addr":"172.21.15.197:6825/23454","heartbeat_front_addr":"172.21.15.197:6823/23454","state":["exists","up"]},{"osd":3,"uuid":"f5627cc2-7063-4e07-b0e1-6c89c2b87b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":23556},{"type":"v1","addr":"172.21.15.197:6827","nonce":23556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":23556},{"type":"v1","addr":"172.21.15.197:6829","nonce":23556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6832","nonce":23556},{"type":"v1","addr":"172.21.15.197:6833","nonce":23556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":23556},{"type":"v1","addr":"172.21.15.197:6831","nonce":23556}]},"public_addr":"172.21.15.197:6827/23556","cluster_addr":"172.21.15.197:6829/23556","heartbeat_back_addr":"172.21.15.197:6833/23556","heartbeat_front_addr":"172.21.15.197:6831/23556","state":["exists","up"]},{"osd":4,"uuid":"da456463-56d5-4da2-81c3-5b4992ff550a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":23098},{"type":"v1","addr":"172.21.15.66:6801","nonce":23098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":23098},{"type":"v1","addr":"172.21.15.66:6803","nonce":23098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":23098},{"type":"v1","addr":"172.21.15.66:6807","nonce":23098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":23098},{"type":"v1","addr":"172.21.15.66:6805","nonce":23098}]},"public_addr":"172.21.15.66:6801/23098","cluster_addr":"172.21.15.66:6803/23098","heartbeat_back_addr":"172.21.15.66:6807/23098","heartbeat_front_addr":"172.21.15.66:6805/23098","state":["exists","up"]},{"osd":5,"uuid":"0bc2583d-5450-413e-8da8-517062319234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":23254},{"type":"v1","addr":"172.21.15.66:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":23254},{"type":"v1","addr":"172.21.15.66:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":23254},{"type":"v1","addr":"172.21.15.66:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":23254},{"type":"v1","addr":"172.21.15.66:6813","nonce":23254}]},"public_addr":"172.21.15.66:6809/23254","cluster_addr":"172.21.15.66:6811/23254","heartbeat_back_addr":"172.21.15.66:6815/23254","heartbeat_front_addr":"172.21.15.66:6813/23254","state":["exists","up"]},{"osd":6,"uuid":"96b7d461-e0bf-4a0d-993a-010b3d2b704a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":23329},{"type":"v1","addr":"172.21.15.66:6817","nonce":23329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":23329},{"type":"v1","addr":"172.21.15.66:6819","nonce":23329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":23329},{"type":"v1","addr":"172.21.15.66:6823","nonce":23329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":23329},{"type":"v1","addr":"172.21.15.66:6821","nonce":23329}]},"public_addr":"172.21.15.66:6817/23329","cluster_addr":"172.21.15.66:6819/23329","heartbeat_back_addr":"172.21.15.66:6823/23329","heartbeat_front_addr":"172.21.15.66:6821/23329","state":["exists","up"]},{"osd":7,"uuid":"b238c2c1-bfa7-46e7-bf31-120e4d8799fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":23472},{"type":"v1","addr":"172.21.15.66:6825","nonce":23472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":23472},{"type":"v1","addr":"172.21.15.66:6827","nonce":23472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":23472},{"type":"v1","addr":"172.21.15.66:6831","nonce":23472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":23472},{"type":"v1","addr":"172.21.15.66:6829","nonce":23472}]},"public_addr":"172.21.15.66:6825/23472","cluster_addr":"172.21.15.66:6827/23472","heartbeat_back_addr":"172.21.15.66:6831/23472","heartbeat_front_addr":"172.21.15.66:6829/23472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.914682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.984284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.005660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.017981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.020554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.170316+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.124245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.192928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:36:17.077 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-28T12:36:17.078 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:17.091 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:36:17.384 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:36:17.385 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":19,"fsid":"f9c8a2f0-dbb1-4a44-842d-48014855150b","created":"2020-04-28T12:35:57.419498+0000","modified":"2020-04-28T12:36:16.396336+0000","last_up_change":"2020-04-28T12:36:07.696385+0000","last_in_change":"2020-04-28T12:36:07.696385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:36:00.566522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:36:13.675163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"009d23fe-2af5-4186-ad00-4278d8d26340","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":23194},{"type":"v1","addr":"172.21.15.197:6803","nonce":23194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6804","nonce":23194},{"type":"v1","addr":"172.21.15.197:6805","nonce":23194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6808","nonce":23194},{"type":"v1","addr":"172.21.15.197:6809","nonce":23194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":23194},{"type":"v1","addr":"172.21.15.197:6807","nonce":23194}]},"public_addr":"172.21.15.197:6803/23194","cluster_addr":"172.21.15.197:6805/23194","heartbeat_back_addr":"172.21.15.197:6809/23194","heartbeat_front_addr":"172.21.15.197:6807/23194","state":["exists","up"]},{"osd":1,"uuid":"c7da0680-297c-4992-9e48-16d46a916070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":23338},{"type":"v1","addr":"172.21.15.197:6811","nonce":23338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":23338},{"type":"v1","addr":"172.21.15.197:6813","nonce":23338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":23338},{"type":"v1","addr":"172.21.15.197:6817","nonce":23338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":23338},{"type":"v1","addr":"172.21.15.197:6815","nonce":23338}]},"public_addr":"172.21.15.197:6811/23338","cluster_addr":"172.21.15.197:6813/23338","heartbeat_back_addr":"172.21.15.197:6817/23338","heartbeat_front_addr":"172.21.15.197:6815/23338","state":["exists","up"]},{"osd":2,"uuid":"13dfdde0-4c8c-46f2-ba87-595100243246","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":23454},{"type":"v1","addr":"172.21.15.197:6819","nonce":23454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":23454},{"type":"v1","addr":"172.21.15.197:6821","nonce":23454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":23454},{"type":"v1","addr":"172.21.15.197:6825","nonce":23454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":23454},{"type":"v1","addr":"172.21.15.197:6823","nonce":23454}]},"public_addr":"172.21.15.197:6819/23454","cluster_addr":"172.21.15.197:6821/23454","heartbeat_back_addr":"172.21.15.197:6825/23454","heartbeat_front_addr":"172.21.15.197:6823/23454","state":["exists","up"]},{"osd":3,"uuid":"f5627cc2-7063-4e07-b0e1-6c89c2b87b4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6826","nonce":23556},{"type":"v1","addr":"172.21.15.197:6827","nonce":23556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6828","nonce":23556},{"type":"v1","addr":"172.21.15.197:6829","nonce":23556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6832","nonce":23556},{"type":"v1","addr":"172.21.15.197:6833","nonce":23556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6830","nonce":23556},{"type":"v1","addr":"172.21.15.197:6831","nonce":23556}]},"public_addr":"172.21.15.197:6827/23556","cluster_addr":"172.21.15.197:6829/23556","heartbeat_back_addr":"172.21.15.197:6833/23556","heartbeat_front_addr":"172.21.15.197:6831/23556","state":["exists","up"]},{"osd":4,"uuid":"da456463-56d5-4da2-81c3-5b4992ff550a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":23098},{"type":"v1","addr":"172.21.15.66:6801","nonce":23098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":23098},{"type":"v1","addr":"172.21.15.66:6803","nonce":23098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":23098},{"type":"v1","addr":"172.21.15.66:6807","nonce":23098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":23098},{"type":"v1","addr":"172.21.15.66:6805","nonce":23098}]},"public_addr":"172.21.15.66:6801/23098","cluster_addr":"172.21.15.66:6803/23098","heartbeat_back_addr":"172.21.15.66:6807/23098","heartbeat_front_addr":"172.21.15.66:6805/23098","state":["exists","up"]},{"osd":5,"uuid":"0bc2583d-5450-413e-8da8-517062319234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":23254},{"type":"v1","addr":"172.21.15.66:6809","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":23254},{"type":"v1","addr":"172.21.15.66:6811","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":23254},{"type":"v1","addr":"172.21.15.66:6815","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":23254},{"type":"v1","addr":"172.21.15.66:6813","nonce":23254}]},"public_addr":"172.21.15.66:6809/23254","cluster_addr":"172.21.15.66:6811/23254","heartbeat_back_addr":"172.21.15.66:6815/23254","heartbeat_front_addr":"172.21.15.66:6813/23254","state":["exists","up"]},{"osd":6,"uuid":"96b7d461-e0bf-4a0d-993a-010b3d2b704a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":23329},{"type":"v1","addr":"172.21.15.66:6817","nonce":23329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":23329},{"type":"v1","addr":"172.21.15.66:6819","nonce":23329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":23329},{"type":"v1","addr":"172.21.15.66:6823","nonce":23329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":23329},{"type":"v1","addr":"172.21.15.66:6821","nonce":23329}]},"public_addr":"172.21.15.66:6817/23329","cluster_addr":"172.21.15.66:6819/23329","heartbeat_back_addr":"172.21.15.66:6823/23329","heartbeat_front_addr":"172.21.15.66:6821/23329","state":["exists","up"]},{"osd":7,"uuid":"b238c2c1-bfa7-46e7-bf31-120e4d8799fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":23472},{"type":"v1","addr":"172.21.15.66:6825","nonce":23472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":23472},{"type":"v1","addr":"172.21.15.66:6827","nonce":23472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":23472},{"type":"v1","addr":"172.21.15.66:6831","nonce":23472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":23472},{"type":"v1","addr":"172.21.15.66:6829","nonce":23472}]},"public_addr":"172.21.15.66:6825/23472","cluster_addr":"172.21.15.66:6827/23472","heartbeat_back_addr":"172.21.15.66:6831/23472","heartbeat_front_addr":"172.21.15.66:6829/23472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.914682+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:05.984284+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.005660+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.017981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.020554+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.170316+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.124245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:36:06.192928+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:36:17.397 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:17.410 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-28T12:36:17.590 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:17.590 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:17.604 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-28T12:36:17.782 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:17.782 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:17.795 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-28T12:36:17.975 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:17.976 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:17.989 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-28T12:36:18.167 INFO:teuthology.orchestra.run.smithi197.stdout:60129542147 2020-04-28T12:36:18.168 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:18.181 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-28T12:36:18.358 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:18.359 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:18.373 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-28T12:36:18.553 INFO:teuthology.orchestra.run.smithi197.stdout:60129542147 2020-04-28T12:36:18.553 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:18.567 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-28T12:36:18.746 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:18.746 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:18.760 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-28T12:36:18.939 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:18.940 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:18.953 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-28T12:36:19.247 INFO:teuthology.orchestra.run.smithi197.stdout:60129542147 2020-04-28T12:36:19.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.0 2020-04-28T12:36:20.258 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:20.275 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-28T12:36:20.580 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:20.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2020-04-28T12:36:20.592 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:20.605 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-28T12:36:20.900 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:20.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2020-04-28T12:36:20.911 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:20.925 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-28T12:36:21.221 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:21.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2020-04-28T12:36:21.233 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:21.247 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-28T12:36:21.542 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:21.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.3 2020-04-28T12:36:21.553 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:21.567 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-28T12:36:21.860 INFO:teuthology.orchestra.run.smithi197.stdout:60129542149 2020-04-28T12:36:21.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.4 2020-04-28T12:36:21.872 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:21.885 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-28T12:36:22.179 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:22.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.5 2020-04-28T12:36:22.190 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:22.204 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-28T12:36:22.498 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:22.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2020-04-28T12:36:22.510 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:22.523 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-28T12:36:22.816 INFO:teuthology.orchestra.run.smithi197.stdout:60129542148 2020-04-28T12:36:22.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.7 2020-04-28T12:36:22.828 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-28T12:36:22.828 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:22.841 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:36:23.130 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:36:23.132 INFO:teuthology.orchestra.run.smithi197.stderr:dumped all 2020-04-28T12:36:23.141 INFO:teuthology.orchestra.run.smithi197.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2020-04-28T12:36:22.556777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369384,"kb_used_data":743225992,"kb_used_omap":330,"kb_used_meta":0,"kb_avail":743225656,"statfs":{"total":767585320960,"available":761063071744,"internally_reserved":344064,"allocated":761063415808,"data_stored":761063415808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":337928,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001291"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404731+0000","last_change":"2020-04-28T12:36:15.404516+0000","last_active":"2020-04-28T12:36:15.404731+0000","last_peered":"2020-04-28T12:36:15.404731+0000","last_clean":"2020-04-28T12:36:15.404731+0000","last_became_active":"2020-04-28T12:36:15.403824+0000","last_became_peered":"2020-04-28T12:36:15.403824+0000","last_unstale":"2020-04-28T12:36:15.404731+0000","last_undegraded":"2020-04-28T12:36:15.404731+0000","last_fullsized":"2020-04-28T12:36:15.404731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404148+0000","last_change":"2020-04-28T12:36:15.403980+0000","last_active":"2020-04-28T12:36:15.404148+0000","last_peered":"2020-04-28T12:36:15.404148+0000","last_clean":"2020-04-28T12:36:15.404148+0000","last_became_active":"2020-04-28T12:36:15.403596+0000","last_became_peered":"2020-04-28T12:36:15.403596+0000","last_unstale":"2020-04-28T12:36:15.404148+0000","last_undegraded":"2020-04-28T12:36:15.404148+0000","last_fullsized":"2020-04-28T12:36:15.404148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404654+0000","last_change":"2020-04-28T12:36:15.404260+0000","last_active":"2020-04-28T12:36:15.404654+0000","last_peered":"2020-04-28T12:36:15.404654+0000","last_clean":"2020-04-28T12:36:15.404654+0000","last_became_active":"2020-04-28T12:36:15.403676+0000","last_became_peered":"2020-04-28T12:36:15.403676+0000","last_unstale":"2020-04-28T12:36:15.404654+0000","last_undegraded":"2020-04-28T12:36:15.404654+0000","last_fullsized":"2020-04-28T12:36:15.404654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.405274+0000","last_change":"2020-04-28T12:36:15.405075+0000","last_active":"2020-04-28T12:36:15.405274+0000","last_peered":"2020-04-28T12:36:15.405274+0000","last_clean":"2020-04-28T12:36:15.405274+0000","last_became_active":"2020-04-28T12:36:15.404613+0000","last_became_peered":"2020-04-28T12:36:15.404613+0000","last_unstale":"2020-04-28T12:36:15.405274+0000","last_undegraded":"2020-04-28T12:36:15.405274+0000","last_fullsized":"2020-04-28T12:36:15.405274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.402198+0000","last_change":"2020-04-28T12:36:08.860974+0000","last_active":"2020-04-28T12:36:15.402198+0000","last_peered":"2020-04-28T12:36:15.402198+0000","last_clean":"2020-04-28T12:36:15.402198+0000","last_became_active":"2020-04-28T12:36:08.860660+0000","last_became_peered":"2020-04-28T12:36:08.860660+0000","last_unstale":"2020-04-28T12:36:15.402198+0000","last_undegraded":"2020-04-28T12:36:15.402198+0000","last_fullsized":"2020-04-28T12:36:15.402198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:01.552502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:01.552502+0000","last_clean_scrub_stamp":"2020-04-28T12:36:01.552502+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.406014+0000","last_change":"2020-04-28T12:36:15.405779+0000","last_active":"2020-04-28T12:36:15.406014+0000","last_peered":"2020-04-28T12:36:15.406014+0000","last_clean":"2020-04-28T12:36:15.406014+0000","last_became_active":"2020-04-28T12:36:15.405393+0000","last_became_peered":"2020-04-28T12:36:15.405393+0000","last_unstale":"2020-04-28T12:36:15.406014+0000","last_undegraded":"2020-04-28T12:36:15.406014+0000","last_fullsized":"2020-04-28T12:36:15.406014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.639615+0000","last_change":"2020-04-28T12:36:15.639470+0000","last_active":"2020-04-28T12:36:15.639615+0000","last_peered":"2020-04-28T12:36:15.639615+0000","last_clean":"2020-04-28T12:36:15.639615+0000","last_became_active":"2020-04-28T12:36:15.639065+0000","last_became_peered":"2020-04-28T12:36:15.639065+0000","last_unstale":"2020-04-28T12:36:15.639615+0000","last_undegraded":"2020-04-28T12:36:15.639615+0000","last_fullsized":"2020-04-28T12:36:15.639615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.406524+0000","last_change":"2020-04-28T12:36:15.406300+0000","last_active":"2020-04-28T12:36:15.406524+0000","last_peered":"2020-04-28T12:36:15.406524+0000","last_clean":"2020-04-28T12:36:15.406524+0000","last_became_active":"2020-04-28T12:36:15.405764+0000","last_became_peered":"2020-04-28T12:36:15.405764+0000","last_unstale":"2020-04-28T12:36:15.406524+0000","last_undegraded":"2020-04-28T12:36:15.406524+0000","last_fullsized":"2020-04-28T12:36:15.406524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404443+0000","last_change":"2020-04-28T12:36:15.404266+0000","last_active":"2020-04-28T12:36:15.404443+0000","last_peered":"2020-04-28T12:36:15.404443+0000","last_clean":"2020-04-28T12:36:15.404443+0000","last_became_active":"2020-04-28T12:36:15.403861+0000","last_became_peered":"2020-04-28T12:36:15.403861+0000","last_unstale":"2020-04-28T12:36:15.404443+0000","last_undegraded":"2020-04-28T12:36:15.404443+0000","last_fullsized":"2020-04-28T12:36:15.404443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796216,"kb_used_data":92903220,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903164,"statfs":{"total":95948165120,"available":95132839936,"internally_reserved":57344,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59869,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7029999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796204,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903176,"statfs":{"total":95948165120,"available":95132852224,"internally_reserved":45056,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38083,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796172,"kb_used_data":92903272,"kb_used_omap":47,"kb_used_meta":0,"kb_avail":92903208,"statfs":{"total":95948165120,"available":95132884992,"internally_reserved":65536,"allocated":95132950528,"data_stored":95132950528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48189,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796148,"kb_used_data":92903272,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903232,"statfs":{"total":95948165120,"available":95132909568,"internally_reserved":40960,"allocated":95132950528,"data_stored":95132950528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54649,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796204,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903176,"statfs":{"total":95948165120,"available":95132852224,"internally_reserved":45056,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38083,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796192,"kb_used_data":92903220,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903188,"statfs":{"total":95948165120,"available":95132864512,"internally_reserved":32768,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32989,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796048,"kb_used_data":92903348,"kb_used_omap":27,"kb_used_meta":0,"kb_avail":92903332,"statfs":{"total":95948165120,"available":95133011968,"internally_reserved":16384,"allocated":95133028352,"data_stored":95133028352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27939,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796200,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903180,"statfs":{"total":95948165120,"available":95132856320,"internally_reserved":40960,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38127,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.752}]}]}]}} 2020-04-28T12:36:23.143 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:23.157 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:36:23.447 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:36:23.450 INFO:teuthology.orchestra.run.smithi197.stderr:dumped all 2020-04-28T12:36:23.458 INFO:teuthology.orchestra.run.smithi197.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2020-04-28T12:36:22.556777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":6369384,"kb_used_data":743225992,"kb_used_omap":330,"kb_used_meta":0,"kb_avail":743225656,"statfs":{"total":767585320960,"available":761063071744,"internally_reserved":344064,"allocated":761063415808,"data_stored":761063415808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":337928,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001291"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404731+0000","last_change":"2020-04-28T12:36:15.404516+0000","last_active":"2020-04-28T12:36:15.404731+0000","last_peered":"2020-04-28T12:36:15.404731+0000","last_clean":"2020-04-28T12:36:15.404731+0000","last_became_active":"2020-04-28T12:36:15.403824+0000","last_became_peered":"2020-04-28T12:36:15.403824+0000","last_unstale":"2020-04-28T12:36:15.404731+0000","last_undegraded":"2020-04-28T12:36:15.404731+0000","last_fullsized":"2020-04-28T12:36:15.404731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404148+0000","last_change":"2020-04-28T12:36:15.403980+0000","last_active":"2020-04-28T12:36:15.404148+0000","last_peered":"2020-04-28T12:36:15.404148+0000","last_clean":"2020-04-28T12:36:15.404148+0000","last_became_active":"2020-04-28T12:36:15.403596+0000","last_became_peered":"2020-04-28T12:36:15.403596+0000","last_unstale":"2020-04-28T12:36:15.404148+0000","last_undegraded":"2020-04-28T12:36:15.404148+0000","last_fullsized":"2020-04-28T12:36:15.404148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404654+0000","last_change":"2020-04-28T12:36:15.404260+0000","last_active":"2020-04-28T12:36:15.404654+0000","last_peered":"2020-04-28T12:36:15.404654+0000","last_clean":"2020-04-28T12:36:15.404654+0000","last_became_active":"2020-04-28T12:36:15.403676+0000","last_became_peered":"2020-04-28T12:36:15.403676+0000","last_unstale":"2020-04-28T12:36:15.404654+0000","last_undegraded":"2020-04-28T12:36:15.404654+0000","last_fullsized":"2020-04-28T12:36:15.404654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.405274+0000","last_change":"2020-04-28T12:36:15.405075+0000","last_active":"2020-04-28T12:36:15.405274+0000","last_peered":"2020-04-28T12:36:15.405274+0000","last_clean":"2020-04-28T12:36:15.405274+0000","last_became_active":"2020-04-28T12:36:15.404613+0000","last_became_peered":"2020-04-28T12:36:15.404613+0000","last_unstale":"2020-04-28T12:36:15.405274+0000","last_undegraded":"2020-04-28T12:36:15.405274+0000","last_fullsized":"2020-04-28T12:36:15.405274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.402198+0000","last_change":"2020-04-28T12:36:08.860974+0000","last_active":"2020-04-28T12:36:15.402198+0000","last_peered":"2020-04-28T12:36:15.402198+0000","last_clean":"2020-04-28T12:36:15.402198+0000","last_became_active":"2020-04-28T12:36:08.860660+0000","last_became_peered":"2020-04-28T12:36:08.860660+0000","last_unstale":"2020-04-28T12:36:15.402198+0000","last_undegraded":"2020-04-28T12:36:15.402198+0000","last_fullsized":"2020-04-28T12:36:15.402198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:01.552502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:01.552502+0000","last_clean_scrub_stamp":"2020-04-28T12:36:01.552502+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.406014+0000","last_change":"2020-04-28T12:36:15.405779+0000","last_active":"2020-04-28T12:36:15.406014+0000","last_peered":"2020-04-28T12:36:15.406014+0000","last_clean":"2020-04-28T12:36:15.406014+0000","last_became_active":"2020-04-28T12:36:15.405393+0000","last_became_peered":"2020-04-28T12:36:15.405393+0000","last_unstale":"2020-04-28T12:36:15.406014+0000","last_undegraded":"2020-04-28T12:36:15.406014+0000","last_fullsized":"2020-04-28T12:36:15.406014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.639615+0000","last_change":"2020-04-28T12:36:15.639470+0000","last_active":"2020-04-28T12:36:15.639615+0000","last_peered":"2020-04-28T12:36:15.639615+0000","last_clean":"2020-04-28T12:36:15.639615+0000","last_became_active":"2020-04-28T12:36:15.639065+0000","last_became_peered":"2020-04-28T12:36:15.639065+0000","last_unstale":"2020-04-28T12:36:15.639615+0000","last_undegraded":"2020-04-28T12:36:15.639615+0000","last_fullsized":"2020-04-28T12:36:15.639615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.406524+0000","last_change":"2020-04-28T12:36:15.406300+0000","last_active":"2020-04-28T12:36:15.406524+0000","last_peered":"2020-04-28T12:36:15.406524+0000","last_clean":"2020-04-28T12:36:15.406524+0000","last_became_active":"2020-04-28T12:36:15.405764+0000","last_became_peered":"2020-04-28T12:36:15.405764+0000","last_unstale":"2020-04-28T12:36:15.406524+0000","last_undegraded":"2020-04-28T12:36:15.406524+0000","last_fullsized":"2020-04-28T12:36:15.406524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:36:15.404443+0000","last_change":"2020-04-28T12:36:15.404266+0000","last_active":"2020-04-28T12:36:15.404443+0000","last_peered":"2020-04-28T12:36:15.404443+0000","last_clean":"2020-04-28T12:36:15.404443+0000","last_became_active":"2020-04-28T12:36:15.403861+0000","last_became_peered":"2020-04-28T12:36:15.403861+0000","last_unstale":"2020-04-28T12:36:15.404443+0000","last_undegraded":"2020-04-28T12:36:15.404443+0000","last_fullsized":"2020-04-28T12:36:15.404443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:36:14.386757+0000","last_clean_scrub_stamp":"2020-04-28T12:36:14.386757+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796216,"kb_used_data":92903220,"kb_used_omap":58,"kb_used_meta":0,"kb_avail":92903164,"statfs":{"total":95948165120,"available":95132839936,"internally_reserved":57344,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59869,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7029999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796204,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903176,"statfs":{"total":95948165120,"available":95132852224,"internally_reserved":45056,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38083,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796172,"kb_used_data":92903272,"kb_used_omap":47,"kb_used_meta":0,"kb_avail":92903208,"statfs":{"total":95948165120,"available":95132884992,"internally_reserved":65536,"allocated":95132950528,"data_stored":95132950528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48189,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796148,"kb_used_data":92903272,"kb_used_omap":53,"kb_used_meta":0,"kb_avail":92903232,"statfs":{"total":95948165120,"available":95132909568,"internally_reserved":40960,"allocated":95132950528,"data_stored":95132950528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54649,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796204,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903176,"statfs":{"total":95948165120,"available":95132852224,"internally_reserved":45056,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38083,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796192,"kb_used_data":92903220,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":92903188,"statfs":{"total":95948165120,"available":95132864512,"internally_reserved":32768,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32989,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796048,"kb_used_data":92903348,"kb_used_omap":27,"kb_used_meta":0,"kb_avail":92903332,"statfs":{"total":95948165120,"available":95133011968,"internally_reserved":16384,"allocated":95133028352,"data_stored":95133028352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27939,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796200,"kb_used_data":92903220,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":92903180,"statfs":{"total":95948165120,"available":95132856320,"internally_reserved":40960,"allocated":95132897280,"data_stored":95132897280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38127,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.752}]}]}]}} 2020-04-28T12:36:23.460 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-28T12:36:23.460 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-28T12:36:23.461 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-28T12:36:23.461 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:23.474 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-28T12:36:23.817 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:36:23.828 INFO:teuthology.orchestra.run.smithi197.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-28T12:36:23.828 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-28T12:36:23.828 INFO:teuthology.run_tasks:Running task openssl_keys... 2020-04-28T12:36:23.842 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}} 2020-04-28T12:36:23.842 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:23.855 INFO:teuthology.orchestra.run.smithi197:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:36:23.909 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:23.961 INFO:teuthology.orchestra.run.smithi197:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2020-04-28T12:36:24.041 INFO:teuthology.orchestra.run.smithi197.stderr:Generating a RSA private key 2020-04-28T12:36:24.093 INFO:teuthology.orchestra.run.smithi197.stderr:...............++++ 2020-04-28T12:36:24.354 INFO:teuthology.orchestra.run.smithi197.stderr:...................................................................................++++ 2020-04-28T12:36:24.355 INFO:teuthology.orchestra.run.smithi197.stderr:writing new private key to '/home/ubuntu/cephtest/ca/root.key' 2020-04-28T12:36:24.355 INFO:teuthology.orchestra.run.smithi197.stderr:----- 2020-04-28T12:36:24.361 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:24.414 INFO:teuthology.orchestra.run.smithi197:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2020-04-28T12:36:24.492 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:24.545 INFO:teuthology.orchestra.run.smithi197:> sudo update-ca-trust 2020-04-28T12:36:24.941 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:24.958 INFO:teuthology.orchestra.run.smithi066:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:36:25.014 INFO:tasks.openssl_keys:copying from ubuntu@smithi197.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt to ubuntu@smithi066.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt... 2020-04-28T12:36:25.031 DEBUG:teuthology.orchestra.remote:smithi197:/home/ubuntu/cephtest/ca/root.crt is 2KB 2020-04-28T12:36:25.098 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:25.114 INFO:teuthology.orchestra.run.smithi066:> sudo mv /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2020-04-28T12:36:25.192 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:25.247 INFO:teuthology.orchestra.run.smithi066:> sudo update-ca-trust 2020-04-28T12:36:25.689 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:25.703 INFO:teuthology.orchestra.run.smithi066:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:36:25.758 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:25.774 INFO:teuthology.orchestra.run.smithi197:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.1.key -out /home/ubuntu/cephtest/ca/rgw.client.1.csr -subj /CN=smithi066.front.sepia.ceph.com 2020-04-28T12:36:25.830 INFO:teuthology.orchestra.run.smithi197.stderr:Generating a RSA private key 2020-04-28T12:36:25.875 INFO:teuthology.orchestra.run.smithi197.stderr:..............................................+++++ 2020-04-28T12:36:25.941 INFO:teuthology.orchestra.run.smithi197.stderr:.....................................................................+++++ 2020-04-28T12:36:25.941 INFO:teuthology.orchestra.run.smithi197.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.1.key' 2020-04-28T12:36:25.941 INFO:teuthology.orchestra.run.smithi197.stderr:----- 2020-04-28T12:36:25.942 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:25.995 INFO:teuthology.orchestra.run.smithi197:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.1.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.1.crt -days 365 -sha256 2020-04-28T12:36:26.054 INFO:teuthology.orchestra.run.smithi197.stderr:Signature ok 2020-04-28T12:36:26.055 INFO:teuthology.orchestra.run.smithi197.stderr:subject=CN = smithi066.front.sepia.ceph.com 2020-04-28T12:36:26.055 INFO:teuthology.orchestra.run.smithi197.stderr:Getting CA Private Key 2020-04-28T12:36:26.060 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:26.113 INFO:teuthology.orchestra.run.smithi197:> rm /home/ubuntu/cephtest/ca/rgw.client.1.csr /home/ubuntu/cephtest/ca/root.srl 2020-04-28T12:36:26.167 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:26.221 INFO:teuthology.orchestra.run.smithi197:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.1.crt 2020-04-28T12:36:26.276 INFO:teuthology.orchestra.run.smithi197.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2020-04-28T12:36:26.276 INFO:tasks.openssl_keys:copying from ubuntu@smithi197.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt to ubuntu@smithi066.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt... 2020-04-28T12:36:26.332 DEBUG:teuthology.orchestra.remote:smithi197:/home/ubuntu/cephtest/ca/rgw.client.1.crt is 1KB 2020-04-28T12:36:26.406 INFO:tasks.openssl_keys:copying from ubuntu@smithi197.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key to ubuntu@smithi066.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key... 2020-04-28T12:36:26.452 DEBUG:teuthology.orchestra.remote:smithi197:/home/ubuntu/cephtest/ca/rgw.client.1.key is 2KB 2020-04-28T12:36:26.520 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:26.534 INFO:teuthology.orchestra.run.smithi197:> rm /home/ubuntu/cephtest/ca/rgw.client.1.crt /home/ubuntu/cephtest/ca/rgw.client.1.key 2020-04-28T12:36:26.588 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:26.603 INFO:teuthology.orchestra.run.smithi066:> openssl verify /home/ubuntu/cephtest/ca/rgw.client.1.crt 2020-04-28T12:36:26.682 INFO:teuthology.orchestra.run.smithi066.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2020-04-28T12:36:26.683 INFO:teuthology.orchestra.run.smithi066:> true 2020-04-28T12:36:26.739 INFO:teuthology.orchestra.run.smithi066:> cat /home/ubuntu/cephtest/ca/rgw.client.1.key >> /home/ubuntu/cephtest/ca/rgw.client.1.crt 2020-04-28T12:36:26.795 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:26.808 INFO:teuthology.orchestra.run.smithi197:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:36:26.862 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:26.917 INFO:teuthology.orchestra.run.smithi197:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi197.front.sepia.ceph.com 2020-04-28T12:36:26.972 INFO:teuthology.orchestra.run.smithi197.stderr:Generating a RSA private key 2020-04-28T12:36:26.991 INFO:teuthology.orchestra.run.smithi197.stderr:...................+++++ 2020-04-28T12:36:26.999 INFO:teuthology.orchestra.run.smithi197.stderr:.......+++++ 2020-04-28T12:36:26.999 INFO:teuthology.orchestra.run.smithi197.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.0.key' 2020-04-28T12:36:26.999 INFO:teuthology.orchestra.run.smithi197.stderr:----- 2020-04-28T12:36:27.001 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:27.053 INFO:teuthology.orchestra.run.smithi197:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 2020-04-28T12:36:27.112 INFO:teuthology.orchestra.run.smithi197.stderr:Signature ok 2020-04-28T12:36:27.112 INFO:teuthology.orchestra.run.smithi197.stderr:subject=CN = smithi197.front.sepia.ceph.com 2020-04-28T12:36:27.112 INFO:teuthology.orchestra.run.smithi197.stderr:Getting CA Private Key 2020-04-28T12:36:27.118 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:27.171 INFO:teuthology.orchestra.run.smithi197:> rm /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl 2020-04-28T12:36:27.225 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:27.277 INFO:teuthology.orchestra.run.smithi197:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2020-04-28T12:36:27.332 INFO:teuthology.orchestra.run.smithi197.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2020-04-28T12:36:27.333 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:27.385 INFO:teuthology.orchestra.run.smithi197:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2020-04-28T12:36:27.440 INFO:teuthology.run_tasks:Running task rgw... 2020-04-28T12:36:27.455 DEBUG:tasks.rgw:config is {'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}} 2020-04-28T12:36:27.455 DEBUG:tasks.rgw:client list is ['client.0'] 2020-04-28T12:36:27.455 INFO:tasks.rgw:Creating data pools 2020-04-28T12:36:27.455 DEBUG:tasks.rgw:Obtaining remote for client client.0 2020-04-28T12:36:27.456 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:27.493 INFO:teuthology.orchestra.run.smithi197:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=2 m=1 --cluster ceph 2020-04-28T12:36:28.459 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:28.472 INFO:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2020-04-28T12:36:30.478 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'default.rgw.buckets.data' created 2020-04-28T12:36:30.489 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:30.504 INFO:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2020-04-28T12:36:31.502 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-04-28T12:36:31.518 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:31.534 INFO:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2020-04-28T12:36:32.498 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'default.rgw.buckets.index' created 2020-04-28T12:36:32.511 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:32.525 INFO:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2020-04-28T12:36:33.516 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-04-28T12:36:33.530 DEBUG:tasks.rgw:Pools created 2020-04-28T12:36:33.530 INFO:tasks.rgw:Configuring compression type = random 2020-04-28T12:36:33.530 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:36:33.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:36:33.531 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:33.546 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:36:33.627 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:33.624+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.510 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.505+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.510 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.505+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.512 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.507+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.512 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.507+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.512 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.508+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.512 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.508+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.519 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.514+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.560+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.561+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.566 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.561+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.566 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.561+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.561+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:36:35.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 10 Creating default zonegroup 2020-04-28T12:36:35.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.562+0000 7fc669721180 20 get_system_obj_state: rctx=0x7fff9f7b83b0 obj=:.pools.avail state=0x55892b12e040 s->prefetch_data=0 2020-04-28T12:36:35.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.563+0000 7fc669721180 10 couldn't find old data placement pools config, setting up new ones for the zone 2020-04-28T12:36:35.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.565+0000 7fc657f16700 0 -- 172.21.15.197:0/1904665023 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7fc648005760 msgr2=0x7fc648004160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:36:35.576 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.572+0000 7fc657715700 0 -- 172.21.15.197:0/1904665023 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7fc64003dde0 msgr2=0x7fc6400404e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:36:35.581 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.576+0000 7fc669721180 10 WARNING: store->list_zones() returned r=-2 2020-04-28T12:36:35.581 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.576+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.581 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.576+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.584 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.579+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.584 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.580+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.584 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.580+0000 7fc669721180 10 could not read realm id: (2) No such file or directory 2020-04-28T12:36:35.585 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.580+0000 7fc669721180 10 WARNING: failed to set zone as default, r=-22 2020-04-28T12:36:35.585 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.580+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.585 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.580+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.588 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.583+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.588 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.584+0000 7fc669721180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:36:35.589 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.584+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.589 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.584+0000 7fc669721180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:36:35.589 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 20 zonegroup default 2020-04-28T12:36:35.589 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:35.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 10 Cannot find current period zone using local zone 2020-04-28T12:36:35.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 10 Using default name default 2020-04-28T12:36:35.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:35.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.585+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:35.592 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.586+0000 7fc669721180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:36:35.592 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.586+0000 7fc669721180 20 zone default found 2020-04-28T12:36:35.592 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:35.586+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:37.521 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:37.516+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:37.521 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:37.516+0000 7fc669721180 20 rados->read ofs=0 len=0 2020-04-28T12:36:37.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:37.531+0000 7fc669721180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:37.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:37.531+0000 7fc669721180 20 started sync module instance, tier type = 2020-04-28T12:36:37.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:37.531+0000 7fc669721180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:36:39.558 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.554+0000 7fc669721180 20 add_watcher() i=0 2020-04-28T12:36:39.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.554+0000 7fc669721180 20 add_watcher() i=1 2020-04-28T12:36:39.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.554+0000 7fc669721180 20 add_watcher() i=2 2020-04-28T12:36:39.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.554+0000 7fc669721180 20 add_watcher() i=3 2020-04-28T12:36:39.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.554+0000 7fc669721180 20 add_watcher() i=4 2020-04-28T12:36:39.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.554+0000 7fc669721180 20 add_watcher() i=5 2020-04-28T12:36:39.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.554+0000 7fc669721180 20 add_watcher() i=6 2020-04-28T12:36:39.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.555+0000 7fc669721180 20 add_watcher() i=7 2020-04-28T12:36:39.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.555+0000 7fc669721180 2 all 8 watchers are set, enabling cache 2020-04-28T12:36:39.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.555+0000 7fc669721180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:36:39.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.555+0000 7fc669721180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:36:39.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:39.555+0000 7fc627fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:36:43.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.529+0000 7fc669721180 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2020-04-28T12:36:43.601 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.596+0000 7fc5967fc700 20 reqs_thread_entry: start 2020-04-28T12:36:43.602 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.597+0000 7fc583fff700 20 reqs_thread_entry: start 2020-04-28T12:36:43.602 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.597+0000 7fc669721180 20 init_complete bucket index max shards: 1999 2020-04-28T12:36:43.602 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.597+0000 7fc582ffd700 20 reqs_thread_entry: start 2020-04-28T12:36:43.617 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.612+0000 7fc627fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:36:43.618 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.614+0000 7fc669721180 20 remove_watcher() i=0 2020-04-28T12:36:43.618 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.614+0000 7fc669721180 2 removed watcher, disabling cache 2020-04-28T12:36:43.619 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.615+0000 7fc669721180 20 remove_watcher() i=1 2020-04-28T12:36:43.620 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.616+0000 7fc669721180 20 remove_watcher() i=2 2020-04-28T12:36:43.622 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.618+0000 7fc669721180 20 remove_watcher() i=3 2020-04-28T12:36:43.623 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.619+0000 7fc669721180 20 remove_watcher() i=4 2020-04-28T12:36:43.625 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.620+0000 7fc669721180 20 remove_watcher() i=5 2020-04-28T12:36:43.626 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.621+0000 7fc669721180 20 remove_watcher() i=6 2020-04-28T12:36:43.627 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.623+0000 7fc669721180 20 remove_watcher() i=7 2020-04-28T12:36:43.632 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2020-04-28T12:36:43.632 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:36:43.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:36:43.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:36:43.633 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:43.687 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-04-28T12:36:43.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.770+0000 7f7ffc426180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:36:43.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.770+0000 7f7ffc426180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:36:43.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.773+0000 7f7f327fc700 20 reqs_thread_entry: start 2020-04-28T12:36:43.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.773+0000 7f7ffc426180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.775+0000 7f7ffc426180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.775+0000 7f7ffc426180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.775+0000 7f7ffc426180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:36:43.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.775+0000 7f7ffc426180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.776+0000 7f7ffc426180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.776+0000 7f7ffc426180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.776+0000 7f7ffc426180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.776+0000 7f7ffc426180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.777+0000 7f7ffc426180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:36:43.787 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"e178e290-c1ed-49b6-b9ff-4b37e8f78ff2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:36:43.787 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'e178e290-c1ed-49b6-b9ff-4b37e8f78ff2', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:36:43.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:36:43.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:36:43.788 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:43.802 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:36:43.882 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.878+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.884 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.879+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.884 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.879+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.885 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.880+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.885 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.880+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.885 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.880+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.885 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.881+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.886 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.882+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:43.902 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:36:43.902 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:36:43.902 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:36:43.903 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:36:43.903 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.903 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:43.904 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.904 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.898+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:36:43.904 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.899+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.904 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.899+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:43.904 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.899+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.905 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.900+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:36:43.905 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.900+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.906 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.900+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.906 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.900+0000 7f2c46d40180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:36:43.906 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.900+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.906 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.900+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.906 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.900+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.906 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.901+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:43.906 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.901+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.908 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.901+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:36:43.908 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.901+0000 7f2c46d40180 20 zonegroup default 2020-04-28T12:36:43.909 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.901+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.909 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.902+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.909 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.902+0000 7f2c46d40180 10 Cannot find current period zone using local zone 2020-04-28T12:36:43.909 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.902+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.909 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.902+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.909 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.902+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.910 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.902+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:43.910 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.902+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.910 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:36:43.910 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 zone default found 2020-04-28T12:36:43.910 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.910 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.910 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 rados->read ofs=0 len=0 2020-04-28T12:36:43.911 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:43.911 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 started sync module instance, tier type = 2020-04-28T12:36:43.911 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.903+0000 7f2c46d40180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:36:43.911 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.906+0000 7f2c35535700 0 -- 172.21.15.197:0/1166654484 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f2c28007a90 msgr2=0x7f2c280020b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:36:43.919 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.914+0000 7f2c46d40180 20 add_watcher() i=0 2020-04-28T12:36:43.919 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.915+0000 7f2c46d40180 20 add_watcher() i=1 2020-04-28T12:36:43.919 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.915+0000 7f2c46d40180 20 add_watcher() i=2 2020-04-28T12:36:43.920 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.915+0000 7f2c46d40180 20 add_watcher() i=3 2020-04-28T12:36:43.920 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.915+0000 7f2c46d40180 20 add_watcher() i=4 2020-04-28T12:36:43.920 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.915+0000 7f2c46d40180 20 add_watcher() i=5 2020-04-28T12:36:43.920 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.915+0000 7f2c46d40180 20 add_watcher() i=6 2020-04-28T12:36:43.921 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.916+0000 7f2c46d40180 20 add_watcher() i=7 2020-04-28T12:36:43.921 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.916+0000 7f2c46d40180 2 all 8 watchers are set, enabling cache 2020-04-28T12:36:43.921 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.916+0000 7f2c46d40180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:36:43.921 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.916+0000 7f2c46d40180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:36:43.921 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.916+0000 7f2c057e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:36:43.922 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.916+0000 7f2c35535700 0 -- 172.21.15.197:0/1491697403 >> v1:172.21.15.197:6789/0 conn(0x559fb4c0e580 legacy=0x559fb4c0f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:36:43.969 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.965+0000 7f2b777fe700 20 reqs_thread_entry: start 2020-04-28T12:36:43.970 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.965+0000 7f2b757fa700 20 reqs_thread_entry: start 2020-04-28T12:36:43.970 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.965+0000 7f2c46d40180 20 init_complete bucket index max shards: 1999 2020-04-28T12:36:43.970 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.965+0000 7f2b637fe700 20 reqs_thread_entry: start 2020-04-28T12:36:43.983 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.979+0000 7f2c057e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:36:43.984 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.980+0000 7f2c46d40180 20 remove_watcher() i=0 2020-04-28T12:36:43.985 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.980+0000 7f2c46d40180 2 removed watcher, disabling cache 2020-04-28T12:36:43.986 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.981+0000 7f2c46d40180 20 remove_watcher() i=1 2020-04-28T12:36:43.987 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.982+0000 7f2c46d40180 20 remove_watcher() i=2 2020-04-28T12:36:43.988 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.984+0000 7f2c46d40180 20 remove_watcher() i=3 2020-04-28T12:36:43.989 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.985+0000 7f2c46d40180 20 remove_watcher() i=4 2020-04-28T12:36:43.990 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.986+0000 7f2c46d40180 20 remove_watcher() i=5 2020-04-28T12:36:43.993 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.988+0000 7f2c46d40180 20 remove_watcher() i=6 2020-04-28T12:36:43.994 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:43.989+0000 7f2c46d40180 20 remove_watcher() i=7 2020-04-28T12:36:43.997 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2020-04-28T12:36:43.997 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:36:43.998 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2020-04-28T12:36:43.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:36:43.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:36:43.998 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.051 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2020-04-28T12:36:44.137 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.132+0000 7f11561ea180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:36:44.137 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.132+0000 7f11561ea180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:36:44.140 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.135+0000 7f108bfff700 20 reqs_thread_entry: start 2020-04-28T12:36:44.140 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.135+0000 7f11561ea180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.141 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.136+0000 7f11561ea180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:44.141 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.136+0000 7f11561ea180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.142 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.137+0000 7f11561ea180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:44.142 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.138+0000 7f11561ea180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.143 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.138+0000 7f11561ea180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:36:44.143 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.139+0000 7f11561ea180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.143 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.139+0000 7f11561ea180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:36:44.149 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2020-04-28T12:36:44.149 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:36:44.149 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:36:44.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:36:44.150 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.163 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2020-04-28T12:36:44.251 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.246+0000 7f84b0df8180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:36:44.251 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.246+0000 7f84b0df8180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:36:44.254 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.250+0000 7f83e6ffd700 20 reqs_thread_entry: start 2020-04-28T12:36:44.254 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.250+0000 7f84b0df8180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.255 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.251+0000 7f84b0df8180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:44.255 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.251+0000 7f84b0df8180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.256 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.251+0000 7f84b0df8180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:36:44.256 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.251+0000 7f84b0df8180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.257 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.252+0000 7f84b0df8180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:44.257 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.252+0000 7f84b0df8180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.257 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.253+0000 7f84b0df8180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:44.258 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.253+0000 7f84b0df8180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.258 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.254+0000 7f84b0df8180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:36:44.263 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"e178e290-c1ed-49b6-b9ff-4b37e8f78ff2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:36:44.263 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'e178e290-c1ed-49b6-b9ff-4b37e8f78ff2', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:36:44.263 INFO:tasks.rgw:Configuring storage class type = FROZEN 2020-04-28T12:36:44.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:36:44.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:36:44.264 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.277 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2020-04-28T12:36:44.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.359+0000 7f5fc2efa180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:36:44.364 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.359+0000 7f5fc2efa180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:36:44.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.362+0000 7f5f00ff9700 20 reqs_thread_entry: start 2020-04-28T12:36:44.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.362+0000 7f5fc2efa180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.363+0000 7f5fc2efa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:44.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.363+0000 7f5fc2efa180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.369 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.364+0000 7f5fc2efa180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:44.369 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.364+0000 7f5fc2efa180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.365+0000 7f5fc2efa180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:36:44.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.365+0000 7f5fc2efa180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.366+0000 7f5fc2efa180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:36:44.375 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2020-04-28T12:36:44.376 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:36:44.376 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:36:44.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:36:44.377 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.391 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2020-04-28T12:36:44.479 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.474+0000 7f63199e3180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:36:44.479 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.474+0000 7f63199e3180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:36:44.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.477+0000 7f624b7fe700 20 reqs_thread_entry: start 2020-04-28T12:36:44.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.477+0000 7f63199e3180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.478+0000 7f63199e3180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.478+0000 7f63199e3180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.479+0000 7f63199e3180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:36:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.479+0000 7f63199e3180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.484 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.479+0000 7f63199e3180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:36:44.484 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.479+0000 7f63199e3180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.484 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.480+0000 7f63199e3180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:36:44.485 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.480+0000 7f63199e3180 20 rados->read ofs=0 len=0 2020-04-28T12:36:44.485 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:36:44.481+0000 7f63199e3180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:36:44.492 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"e178e290-c1ed-49b6-b9ff-4b37e8f78ff2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:36:44.492 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'e178e290-c1ed-49b6-b9ff-4b37e8f78ff2', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:36:44.492 INFO:tasks.rgw:Starting rgw... 2020-04-28T12:36:44.492 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2020-04-28T12:36:44.493 INFO:tasks.rgw:Using civetweb as radosgw frontend 2020-04-28T12:36:44.493 INFO:tasks.rgw.client.0:Restarting daemon 2020-04-28T12:36:44.493 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.506 INFO:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt port=443s' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2020-04-28T12:36:44.549 INFO:tasks.rgw.client.0:Started 2020-04-28T12:36:44.549 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi197.front.sepia.ceph.com:443/ 2020-04-28T12:36:44.549 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.564 INFO:teuthology.orchestra.run.smithi197:> curl https://smithi197.front.sepia.ceph.com:443/ 2020-04-28T12:36:44.740 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-04-28T12:36:44.740 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2020-04-28T12:36:44.826 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 2488 0 --:--:-- --:--:-- --:--:-- 2517 2020-04-28T12:36:44.827 INFO:teuthology.orchestra.run.smithi197.stdout:anonymous 2020-04-28T12:36:44.827 INFO:teuthology.run_tasks:Running task workunit... 2020-04-28T12:36:44.842 INFO:tasks.workunit:Pulling workunits from ref a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:36:44.843 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-28T12:36:44.843 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.860 INFO:teuthology.orchestra.run.smithi197:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:36:44.914 INFO:teuthology.orchestra.run.smithi197.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-28T12:36:44.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:36:44.915 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:44.968 INFO:teuthology.orchestra.run.smithi197:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:36:45.022 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-04-28T12:36:45.022 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:45.077 INFO:teuthology.orchestra.run.smithi197:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-04-28T12:36:45.131 INFO:tasks.workunit:timeout=3h 2020-04-28T12:36:45.131 INFO:tasks.workunit:cleanup=True 2020-04-28T12:36:45.132 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:36:45.185 INFO:teuthology.orchestra.run.smithi197:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:36:45.287 INFO:tasks.workunit.client.0.smithi197.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-28T12:38:11.049 INFO:tasks.workunit.client.0.smithi197.stderr:Note: checking out 'a8c125c7d78f5cd973863993d258cd717ade4c99'. 2020-04-28T12:38:11.049 INFO:tasks.workunit.client.0.smithi197.stderr: 2020-04-28T12:38:11.049 INFO:tasks.workunit.client.0.smithi197.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-28T12:38:11.049 INFO:tasks.workunit.client.0.smithi197.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-28T12:38:11.049 INFO:tasks.workunit.client.0.smithi197.stderr:state without impacting any branches by performing another checkout. 2020-04-28T12:38:11.050 INFO:tasks.workunit.client.0.smithi197.stderr: 2020-04-28T12:38:11.050 INFO:tasks.workunit.client.0.smithi197.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-28T12:38:11.050 INFO:tasks.workunit.client.0.smithi197.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-28T12:38:11.050 INFO:tasks.workunit.client.0.smithi197.stderr: 2020-04-28T12:38:11.050 INFO:tasks.workunit.client.0.smithi197.stderr: git checkout -b 2020-04-28T12:38:11.050 INFO:tasks.workunit.client.0.smithi197.stderr: 2020-04-28T12:38:11.050 INFO:tasks.workunit.client.0.smithi197.stderr:HEAD is now at a8c125c7d7 Merge pull request #34750 from yuriw/wip-yuriw-distro-octupus 2020-04-28T12:38:11.052 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:38:11.065 INFO:teuthology.orchestra.run.smithi197:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-28T12:38:11.126 INFO:tasks.workunit.client.0.smithi197.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-28T12:38:11.128 INFO:tasks.workunit.client.0.smithi197.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:38:11.128 INFO:tasks.workunit.client.0.smithi197.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-28T12:38:11.803 INFO:tasks.workunit.client.0.smithi197.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-28T12:38:11.859 INFO:tasks.workunit.client.0.smithi197.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-28T12:38:11.896 INFO:tasks.workunit.client.0.smithi197.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:38:11.898 INFO:tasks.workunit.client.0.smithi197.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:38:11.898 INFO:tasks.workunit.client.0.smithi197.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-28T12:38:11.934 INFO:tasks.workunit.client.0.smithi197.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:38:11.994 DEBUG:teuthology.orchestra.remote:smithi197:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-28T12:38:12.053 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2020-04-28T12:38:12.054 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2020-04-28T12:38:12.054 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:38:12.067 INFO:teuthology.orchestra.run.smithi197:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2020-04-28T12:38:12.134 INFO:tasks.workunit.client.0.smithi197.stdout:Running main() from gmock_main.cc 2020-04-28T12:38:12.134 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] Running 11 tests from 1 test suite. 2020-04-28T12:38:12.134 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment set-up. 2020-04-28T12:38:12.134 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 11 tests from ClsLock 2020-04-28T12:38:12.134 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestMultiLocking 2020-04-28T12:38:13.516 INFO:tasks.workunit.client.0.smithi197.stdout:lock: mylock 2020-04-28T12:38:13.517 INFO:tasks.workunit.client.0.smithi197.stdout: lock_type: exclusive 2020-04-28T12:38:13.517 INFO:tasks.workunit.client.0.smithi197.stdout: tag: 2020-04-28T12:38:13.517 INFO:tasks.workunit.client.0.smithi197.stdout: lockers: 2020-04-28T12:38:13.517 INFO:tasks.workunit.client.0.smithi197.stdout: client.4412 expiration=2020-04-28T12:40:13.504208+0000 addr=v1:172.21.15.197:0/677718914 cookie= 2020-04-28T12:38:13.525 INFO:tasks.workunit.client.0.smithi197.stdout:lock: mylock 2020-04-28T12:38:13.525 INFO:tasks.workunit.client.0.smithi197.stdout: lock_type: shared 2020-04-28T12:38:13.525 INFO:tasks.workunit.client.0.smithi197.stdout: tag: 2020-04-28T12:38:13.526 INFO:tasks.workunit.client.0.smithi197.stdout: lockers: 2020-04-28T12:38:13.526 INFO:tasks.workunit.client.0.smithi197.stdout: client.4412 expiration=2020-04-28T12:40:13.519326+0000 addr=v1:172.21.15.197:0/677718914 cookie= 2020-04-28T12:38:13.526 INFO:tasks.workunit.client.0.smithi197.stdout: client.4654 expiration=0.000000 addr=v1:172.21.15.197:0/1615713721 cookie= 2020-04-28T12:38:13.527 INFO:tasks.workunit.client.0.smithi197.stdout:lock: mylock 2020-04-28T12:38:13.527 INFO:tasks.workunit.client.0.smithi197.stdout: lock_type: shared 2020-04-28T12:38:13.527 INFO:tasks.workunit.client.0.smithi197.stdout: tag: 2020-04-28T12:38:13.527 INFO:tasks.workunit.client.0.smithi197.stdout: lockers: 2020-04-28T12:38:13.527 INFO:tasks.workunit.client.0.smithi197.stdout: client.4654 expiration=0.000000 addr=v1:172.21.15.197:0/1615713721 cookie= 2020-04-28T12:38:14.471 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestMultiLocking (2337 ms) 2020-04-28T12:38:14.472 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestMeta 2020-04-28T12:38:16.722 INFO:tasks.workunit.client.0.smithi197.stdout:lock: mylock 2020-04-28T12:38:16.723 INFO:tasks.workunit.client.0.smithi197.stdout: lock_type: shared 2020-04-28T12:38:16.723 INFO:tasks.workunit.client.0.smithi197.stdout: tag: 2020-04-28T12:38:16.723 INFO:tasks.workunit.client.0.smithi197.stdout: lockers: 2020-04-28T12:38:16.723 INFO:tasks.workunit.client.0.smithi197.stdout: client.4669 expiration=0.000000 addr=v1:172.21.15.197:0/3735491853 cookie= 2020-04-28T12:38:16.725 INFO:tasks.workunit.client.0.smithi197.stdout:lock: mylock 2020-04-28T12:38:16.726 INFO:tasks.workunit.client.0.smithi197.stdout: lock_type: exclusive 2020-04-28T12:38:16.726 INFO:tasks.workunit.client.0.smithi197.stdout: tag: new_tag 2020-04-28T12:38:16.726 INFO:tasks.workunit.client.0.smithi197.stdout: lockers: 2020-04-28T12:38:16.726 INFO:tasks.workunit.client.0.smithi197.stdout: client.4421 expiration=0.000000 addr=v1:172.21.15.197:0/471063246 cookie= 2020-04-28T12:38:17.484 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestMeta (3013 ms) 2020-04-28T12:38:17.484 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestCookie 2020-04-28T12:38:19.534 INFO:tasks.workunit.client.0.smithi197.stdout:lock: mylock 2020-04-28T12:38:19.534 INFO:tasks.workunit.client.0.smithi197.stdout: lock_type: exclusive 2020-04-28T12:38:19.534 INFO:tasks.workunit.client.0.smithi197.stdout: tag: 2020-04-28T12:38:19.534 INFO:tasks.workunit.client.0.smithi197.stdout: lockers: 2020-04-28T12:38:19.536 INFO:tasks.workunit.client.0.smithi197.stdout:lock: mylock 2020-04-28T12:38:19.537 INFO:tasks.workunit.client.0.smithi197.stdout: lock_type: shared 2020-04-28T12:38:19.537 INFO:tasks.workunit.client.0.smithi197.stdout: tag: 2020-04-28T12:38:19.537 INFO:tasks.workunit.client.0.smithi197.stdout: lockers: 2020-04-28T12:38:19.537 INFO:tasks.workunit.client.0.smithi197.stdout: client.4430 expiration=0.000000 addr=v1:172.21.15.197:0/856210536 cookie= 2020-04-28T12:38:19.537 INFO:tasks.workunit.client.0.smithi197.stdout: client.4430 expiration=0.000000 addr=v1:172.21.15.197:0/856210536 cookie=new cookie 2020-04-28T12:38:20.507 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestCookie (3023 ms) 2020-04-28T12:38:20.507 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestMultipleLocks 2020-04-28T12:38:23.536 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestMultipleLocks (3028 ms) 2020-04-28T12:38:23.536 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestLockDuration 2020-04-28T12:38:30.680 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestLockDuration (7145 ms) 2020-04-28T12:38:30.680 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestAssertLocked 2020-04-28T12:38:33.684 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestAssertLocked (3004 ms) 2020-04-28T12:38:33.684 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestSetCookie 2020-04-28T12:38:36.694 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestSetCookie (3010 ms) 2020-04-28T12:38:36.694 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestRenew 2020-04-28T12:38:57.449 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestRenew (20754 ms) 2020-04-28T12:38:57.449 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2020-04-28T12:39:04.478 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7030 ms) 2020-04-28T12:39:04.478 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2020-04-28T12:39:11.695 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7211 ms) 2020-04-28T12:39:11.695 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2020-04-28T12:39:19.436 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7745 ms) 2020-04-28T12:39:19.436 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 11 tests from ClsLock (67301 ms total) 2020-04-28T12:39:19.437 INFO:tasks.workunit.client.0.smithi197.stdout: 2020-04-28T12:39:19.437 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment tear-down 2020-04-28T12:39:19.437 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] 11 tests from 1 test suite ran. (67301 ms total) 2020-04-28T12:39:19.437 INFO:tasks.workunit.client.0.smithi197.stdout:[ PASSED ] 11 tests. 2020-04-28T12:39:19.438 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:39:19.495 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:39:19.495 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:39:19.605 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2020-04-28T12:39:19.605 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2020-04-28T12:39:19.606 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:39:19.627 INFO:teuthology.orchestra.run.smithi197:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2020-04-28T12:39:19.698 INFO:tasks.workunit.client.0.smithi197.stdout:Running main() from gmock_main.cc 2020-04-28T12:39:19.699 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:39:19.699 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment set-up. 2020-04-28T12:39:19.699 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 4 tests from cls_log 2020-04-28T12:39:19.699 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_log.test_log_add_same_time 2020-04-28T12:39:22.450 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_log.test_log_add_same_time (2747 ms) 2020-04-28T12:39:22.450 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_log.test_log_add_different_time 2020-04-28T12:39:25.486 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_log.test_log_add_different_time (3041 ms) 2020-04-28T12:39:25.487 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_log.trim_by_time 2020-04-28T12:39:28.493 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_log.trim_by_time (3006 ms) 2020-04-28T12:39:28.493 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_log.trim_by_marker 2020-04-28T12:39:31.496 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_log.trim_by_marker (3004 ms) 2020-04-28T12:39:31.496 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 4 tests from cls_log (11798 ms total) 2020-04-28T12:39:31.496 INFO:tasks.workunit.client.0.smithi197.stdout: 2020-04-28T12:39:31.496 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment tear-down 2020-04-28T12:39:31.497 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] 4 tests from 1 test suite ran. (11798 ms total) 2020-04-28T12:39:31.497 INFO:tasks.workunit.client.0.smithi197.stdout:[ PASSED ] 4 tests. 2020-04-28T12:39:31.498 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:39:31.553 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:39:31.553 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:39:31.630 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2020-04-28T12:39:31.630 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2020-04-28T12:39:31.631 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:39:31.677 INFO:teuthology.orchestra.run.smithi197:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2020-04-28T12:39:31.747 INFO:tasks.workunit.client.0.smithi197.stdout:Running main() from gmock_main.cc 2020-04-28T12:39:31.747 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:39:31.747 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment set-up. 2020-04-28T12:39:31.747 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 5 tests from cls_rgw 2020-04-28T12:39:31.747 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.test_implicit 2020-04-28T12:39:34.526 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.test_implicit (2778 ms) 2020-04-28T12:39:34.526 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2020-04-28T12:39:37.554 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3028 ms) 2020-04-28T12:39:37.554 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.test_put_snap 2020-04-28T12:39:44.442 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:39:44.436+0000 7f405d598700 -1 osd.7 pg_epoch: 96 pg[26.6( v 95'4 (0'0,95'4] local-lis/les=92/93 n=2 ec=92/92 lis/c=92/92 les/c/f=93/93/0 sis=92) [7,6] r=0 lpr=92 crt=94'3 lcod 94'3 mlcod 94'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2020-04-28T12:39:46.448 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.test_put_snap (8894 ms) 2020-04-28T12:39:46.448 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.test_explicit 2020-04-28T12:39:49.480 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.test_explicit (3025 ms) 2020-04-28T12:39:49.480 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.set 2020-04-28T12:39:52.490 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.set (3016 ms) 2020-04-28T12:39:52.490 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 5 tests from cls_rgw (20742 ms total) 2020-04-28T12:39:52.490 INFO:tasks.workunit.client.0.smithi197.stdout: 2020-04-28T12:39:52.490 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment tear-down 2020-04-28T12:39:52.491 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] 5 tests from 1 test suite ran. (20743 ms total) 2020-04-28T12:39:52.491 INFO:tasks.workunit.client.0.smithi197.stdout:[ PASSED ] 5 tests. 2020-04-28T12:39:52.492 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:39:52.548 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:39:52.549 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:39:52.625 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2020-04-28T12:39:52.625 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2020-04-28T12:39:52.625 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:39:52.678 INFO:teuthology.orchestra.run.smithi197:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2020-04-28T12:39:52.749 INFO:tasks.workunit.client.0.smithi197.stdout:Running main() from gmock_main.cc 2020-04-28T12:39:52.749 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] Running 14 tests from 1 test suite. 2020-04-28T12:39:52.749 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment set-up. 2020-04-28T12:39:52.749 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 14 tests from cls_rgw 2020-04-28T12:39:54.510 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.index_basic 2020-04-28T12:39:54.580 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.index_basic (68 ms) 2020-04-28T12:39:54.580 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2020-04-28T12:39:54.616 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (37 ms) 2020-04-28T12:39:54.616 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.index_remove_object 2020-04-28T12:39:54.677 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.index_remove_object (61 ms) 2020-04-28T12:39:54.677 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.index_suggest 2020-04-28T12:39:56.408 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.index_suggest (1731 ms) 2020-04-28T12:39:56.408 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.index_list 2020-04-28T12:39:56.438 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.index_list (30 ms) 2020-04-28T12:39:56.439 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.index_list_delimited 2020-04-28T12:40:26.046 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.index_list_delimited (29608 ms) 2020-04-28T12:40:26.046 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.bi_list 2020-04-28T12:40:26.162 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.bi_list (115 ms) 2020-04-28T12:40:26.162 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.gc_set 2020-04-28T12:40:26.178 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.gc_set (17 ms) 2020-04-28T12:40:26.178 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.gc_list 2020-04-28T12:40:26.199 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.gc_list (16 ms) 2020-04-28T12:40:26.199 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.gc_defer 2020-04-28T12:40:33.499 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.gc_defer (7305 ms) 2020-04-28T12:40:33.499 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.usage_basic 2020-04-28T12:40:33.624 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.usage_basic (124 ms) 2020-04-28T12:40:33.624 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2020-04-28T12:40:33.626 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2020-04-28T12:40:33.626 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.usage_clear 2020-04-28T12:40:33.742 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.usage_clear (117 ms) 2020-04-28T12:40:33.742 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] cls_rgw.bi_log_trim 2020-04-28T12:40:33.891 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] cls_rgw.bi_log_trim (148 ms) 2020-04-28T12:40:34.499 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 14 tests from cls_rgw (39381 ms total) 2020-04-28T12:40:34.499 INFO:tasks.workunit.client.0.smithi197.stdout: 2020-04-28T12:40:34.499 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment tear-down 2020-04-28T12:40:34.500 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] 14 tests from 1 test suite ran. (41751 ms total) 2020-04-28T12:40:34.500 INFO:tasks.workunit.client.0.smithi197.stdout:[ PASSED ] 14 tests. 2020-04-28T12:40:34.501 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:34.556 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:40:34.557 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:40:34.636 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2020-04-28T12:40:34.636 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2020-04-28T12:40:34.637 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:34.681 INFO:teuthology.orchestra.run.smithi197:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2020-04-28T12:40:34.759 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] Running 6 tests from 1 test suite. 2020-04-28T12:40:34.759 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment set-up. 2020-04-28T12:40:36.512 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 6 tests from rgw_gc_log 2020-04-28T12:40:36.513 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2020-04-28T12:40:36.531 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] rgw_gc_log.init_existing_queue (19 ms) 2020-04-28T12:40:36.531 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2020-04-28T12:40:36.537 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] rgw_gc_log.init_existing_omap (6 ms) 2020-04-28T12:40:36.537 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2020-04-28T12:40:36.542 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2020-04-28T12:40:36.542 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2020-04-28T12:40:36.543 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2020-04-28T12:40:36.543 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2020-04-28T12:40:36.547 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2020-04-28T12:40:36.547 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2020-04-28T12:40:36.550 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2020-04-28T12:40:36.550 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 6 tests from rgw_gc_log (37 ms total) 2020-04-28T12:40:36.550 INFO:tasks.workunit.client.0.smithi197.stdout: 2020-04-28T12:40:36.550 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment tear-down 2020-04-28T12:40:37.512 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] 6 tests from 1 test suite ran. (2753 ms total) 2020-04-28T12:40:37.512 INFO:tasks.workunit.client.0.smithi197.stdout:[ PASSED ] 6 tests. 2020-04-28T12:40:37.514 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:37.570 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:40:37.571 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:40:37.645 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2020-04-28T12:40:37.646 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2020-04-28T12:40:37.646 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:37.698 INFO:teuthology.orchestra.run.smithi197:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2020-04-28T12:40:37.774 INFO:tasks.workunit.client.0.smithi197.stdout:Running main() from gmock_main.cc 2020-04-28T12:40:37.775 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:40:37.775 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment set-up. 2020-04-28T12:40:37.775 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 4 tests from TestRGWObj 2020-04-28T12:40:37.775 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] TestRGWObj.underscore 2020-04-28T12:40:37.775 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.775 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.776 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns= i= 2020-04-28T12:40:37.776 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.776 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.776 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns= i= 2020-04-28T12:40:37.776 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.776 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.776 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns= i= 2020-04-28T12:40:37.777 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.777 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.777 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.777 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.777 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.777 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.777 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.778 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.778 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.778 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.778 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.778 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.778 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.778 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.779 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.779 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.779 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.779 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.779 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.779 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.779 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.780 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.781 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.781 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.781 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.781 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.781 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.781 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.781 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.782 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.782 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.782 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.782 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.782 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.782 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.782 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.783 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.784 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.784 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.784 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.784 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.784 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.784 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.784 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.785 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.786 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.786 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.786 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.786 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.786 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.786 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.786 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.787 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.787 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.787 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.787 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns=ns i= 2020-04-28T12:40:37.787 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.787 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.787 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns=ns i= 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns=ns i= 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.788 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.789 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.789 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.789 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.789 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.789 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.789 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.789 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.790 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.790 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.790 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.790 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.790 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.790 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.790 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.791 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.791 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.791 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.791 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.791 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.791 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.791 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.792 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.793 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.793 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.793 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.793 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.793 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.793 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.793 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.794 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.794 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.794 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.794 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.794 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.794 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.794 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.795 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.796 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.796 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.796 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.796 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.796 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.796 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.796 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.797 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.797 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.797 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.797 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.797 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.797 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.797 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.798 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.798 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.798 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.798 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.798 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.798 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.798 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns= i=v1 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns= i=v1 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns= i=v1 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.799 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.800 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.800 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.800 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.800 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.800 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.800 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.800 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.801 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.801 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.801 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.801 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.801 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.801 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.801 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.802 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.803 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.803 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.803 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.803 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.803 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.803 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.803 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.804 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.804 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.804 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.804 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.804 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.804 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.804 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.805 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.806 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.806 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.806 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.806 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.806 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.806 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.807 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.808 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.808 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.808 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.808 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.808 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.808 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.808 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.809 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.809 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.809 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.809 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.809 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.809 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.809 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.810 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.810 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.810 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:40:37.810 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.810 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.810 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:40:37.811 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.811 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: _obj[v1] 2020-04-28T12:40:37.811 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:40:37.811 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.811 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.811 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.811 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.812 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.812 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.812 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.812 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.812 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.812 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.812 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.813 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.813 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.813 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.813 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.813 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.813 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.813 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.814 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.814 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.814 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.814 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.814 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.814 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.814 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.815 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.816 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.816 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.816 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.816 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.816 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.816 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.817 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.817 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.817 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.817 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.817 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.817 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.817 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.818 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.818 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.818 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.818 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.818 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.818 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.818 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.819 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.820 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.820 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.820 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.820 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.820 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.820 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.820 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_obj", 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2020-04-28T12:40:37.821 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] TestRGWObj.no_underscore 2020-04-28T12:40:37.822 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.822 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.822 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns= i= 2020-04-28T12:40:37.822 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.822 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.822 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns= i= 2020-04-28T12:40:37.822 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns= i= 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.823 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.824 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.824 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.824 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.824 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.824 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.824 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.824 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.825 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.825 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.825 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.825 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.825 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.825 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.825 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.826 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.826 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.826 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.826 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.826 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.826 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.826 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.827 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.827 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.827 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.827 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.827 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.827 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.828 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.829 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.829 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.829 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.829 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.829 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.829 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.829 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.830 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.830 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.830 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.830 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.830 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.830 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.830 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.831 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.832 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.832 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.832 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.832 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.832 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.832 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.832 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns=ns i= 2020-04-28T12:40:37.833 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.834 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.834 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns=ns i= 2020-04-28T12:40:37.834 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.834 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj 2020-04-28T12:40:37.834 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns=ns i= 2020-04-28T12:40:37.834 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.834 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.835 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.835 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.835 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.835 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.835 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.835 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.835 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.836 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.836 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.836 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.836 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.836 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.836 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.836 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.837 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.838 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.838 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.838 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.838 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.838 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.838 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.838 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.839 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.839 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.839 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.839 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.839 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.839 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.839 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.840 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.840 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.840 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.840 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.840 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.841 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.842 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.842 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.842 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.842 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.842 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.842 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.842 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.843 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.843 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.843 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.843 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.843 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.843 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.843 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.844 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.844 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.844 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.844 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.844 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.844 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.844 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.845 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.845 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.845 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.845 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.845 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns= i=v1 2020-04-28T12:40:37.845 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.845 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.846 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns= i=v1 2020-04-28T12:40:37.846 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.846 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.846 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns= i=v1 2020-04-28T12:40:37.846 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.846 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.846 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.847 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.848 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.848 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.848 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.848 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.848 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.848 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.848 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.849 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.849 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.849 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.849 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.849 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.849 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.849 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.850 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.850 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.850 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.850 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.850 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.850 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.850 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.851 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.852 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.852 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.852 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.852 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.852 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.852 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.852 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.853 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.853 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.853 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.853 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.853 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.853 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.853 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.854 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.854 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.854 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.854 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.854 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.854 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.854 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.855 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.856 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.856 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.856 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.856 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.857 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.857 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.857 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.857 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:40:37.857 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.857 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.857 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:40:37.858 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.858 INFO:tasks.workunit.client.0.smithi197.stdout:parsed: obj[v1] 2020-04-28T12:40:37.858 INFO:tasks.workunit.client.0.smithi197.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:40:37.858 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.858 INFO:tasks.workunit.client.0.smithi197.stdout: "obj1": { 2020-04-28T12:40:37.858 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.858 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.859 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.859 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.859 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.859 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.859 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.859 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.859 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.860 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.860 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.860 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.860 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.860 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.860 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.860 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: "obj2": { 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.861 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.862 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.862 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.862 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.862 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.862 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.862 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.862 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3": { 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.863 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.864 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.865 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.865 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.865 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.865 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.865 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.865 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.865 INFO:tasks.workunit.client.0.smithi197.stdout: "obj3-2": { 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.866 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "obj", 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "v1", 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.867 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] TestRGWObj.obj_to_raw 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.868 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.869 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.869 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.869 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.869 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.869 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.869 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.869 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.870 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.870 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.870 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.870 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.870 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.870 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.870 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.871 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.872 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.873 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.873 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:37.873 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker_myobj", 2020-04-28T12:40:37.873 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.873 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.873 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.874 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.875 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.875 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.875 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.875 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.875 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.875 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.875 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.876 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.876 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.876 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.876 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.876 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.876 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.876 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.877 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.878 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.878 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.878 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.878 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.878 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.878 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.878 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.879 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.879 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.879 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.879 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.879 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.879 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.879 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.880 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.880 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.880 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.880 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.880 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.880 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.880 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker_myobj", 2020-04-28T12:40:37.881 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.882 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.882 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.882 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.882 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.882 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.882 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.882 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.883 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.883 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.883 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.883 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.883 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.883 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.883 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.884 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.885 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.886 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.886 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.886 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.886 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.886 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.886 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.886 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.887 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.887 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.887 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.887 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.887 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.887 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.888 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.889 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.889 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.889 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.889 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.889 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.889 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.890 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.890 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.890 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.890 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.890 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.890 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.891 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.891 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:37.891 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:40:37.891 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.891 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.891 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.891 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.892 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.892 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.892 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.892 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.892 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.892 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.893 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.893 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.893 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.893 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.893 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.894 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.894 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.894 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.894 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.894 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.894 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.894 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.895 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.895 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.895 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.895 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.895 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.895 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.897 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.897 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.898 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.898 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.898 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.899 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.899 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.899 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.899 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.900 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.900 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.900 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.900 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.900 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.900 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.900 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.901 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.901 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.901 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.901 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.901 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.901 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.902 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.902 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.902 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.902 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.902 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.902 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.903 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.903 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.903 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:37.903 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:40:37.903 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.903 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.904 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.904 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.904 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.904 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.904 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.904 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.905 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.905 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.905 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.905 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.905 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.905 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.906 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.907 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.907 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.907 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.907 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.907 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.907 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.907 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.908 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.908 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.908 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.908 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.908 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.908 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.908 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.909 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.909 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.909 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.909 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.909 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.910 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.910 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.910 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.910 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.910 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.910 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.910 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.911 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.911 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.911 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.912 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.912 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.912 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.912 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.912 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.912 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.912 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.913 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.913 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.913 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.913 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.913 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.913 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.913 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.914 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:37.914 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:40:37.914 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.914 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.914 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.914 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.915 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.915 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.915 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.915 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.915 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.915 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.915 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.916 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.916 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.916 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.916 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.916 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.916 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.916 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.917 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.917 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.917 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.917 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.917 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.917 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.917 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.918 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.918 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.918 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.918 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.918 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.918 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.919 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.919 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.919 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.919 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.919 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.919 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.919 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.920 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.920 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.920 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.920 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.920 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.920 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.920 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.921 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.921 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.921 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.921 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.921 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.921 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.922 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.922 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.922 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.922 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.922 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.923 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.923 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.923 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:37.923 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:40:37.923 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.923 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.923 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.924 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.924 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.924 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.924 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.924 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.924 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.924 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.925 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.926 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.926 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.926 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.926 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.926 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.926 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.926 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.927 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.927 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.927 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.927 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.927 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.927 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.928 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.929 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.929 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.929 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.929 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.929 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.929 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.929 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.930 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.930 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.930 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.930 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.930 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.930 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.930 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:40:37.931 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.932 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.932 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.932 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.932 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.933 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.934 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.934 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.934 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.934 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.934 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.934 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.935 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.936 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.936 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.936 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.936 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.936 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.937 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.937 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.937 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.937 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.937 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.937 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.937 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.938 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.938 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.938 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.938 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.938 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.938 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.938 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.939 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.940 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.940 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.940 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.940 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.940 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:37.940 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:40:37.940 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.941 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.941 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.941 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.941 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.941 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.941 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.941 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.942 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.942 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.942 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.942 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.942 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.943 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.943 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.943 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.943 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.943 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:37.943 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.943 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.944 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.944 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.944 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.944 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.944 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.944 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.944 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.945 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.945 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.945 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.945 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.945 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.945 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.945 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.946 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.946 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.946 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.946 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.946 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.950 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.950 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.951 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.951 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.951 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.951 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.951 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.951 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.952 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.952 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.952 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.952 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.952 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.952 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.952 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.953 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.953 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.953 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.953 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.953 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:37.953 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj", 2020-04-28T12:40:37.953 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:37.954 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.954 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.954 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.954 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.954 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.954 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.954 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.955 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.955 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.955 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.955 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.955 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.955 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.955 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.956 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.956 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.956 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.956 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.956 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.956 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.957 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.957 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.957 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.957 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.957 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.957 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.958 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.958 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.958 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.958 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.958 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.958 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.959 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.959 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.959 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.959 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.959 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.960 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.960 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.960 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.960 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.960 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.960 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.961 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.961 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.961 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.961 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.961 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.961 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.962 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.962 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.962 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.962 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.962 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.962 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.963 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.963 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.963 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:37.963 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj", 2020-04-28T12:40:37.963 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:37.963 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.964 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.964 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.964 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.964 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.964 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.964 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.965 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.965 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.965 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.965 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.965 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.965 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.965 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.966 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.966 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.966 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.966 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.966 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.966 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.967 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.967 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.967 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.967 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.967 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.967 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.968 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.968 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.968 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.968 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.968 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.968 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.969 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.969 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.969 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.969 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.969 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.969 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.969 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.970 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.970 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.970 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.970 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.970 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.971 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.971 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.971 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.971 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.971 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.972 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.972 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.972 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.972 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.972 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.972 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.973 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.973 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.973 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:37.973 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:40:37.973 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.973 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.974 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.974 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.974 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.974 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.974 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.975 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.975 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.975 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.975 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.975 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.976 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.976 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.976 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.976 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.976 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.976 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.977 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.977 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.977 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.977 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.977 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.977 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.978 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.978 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.978 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.978 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.978 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.978 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.978 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.979 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.979 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.979 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.979 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.979 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.979 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.979 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.980 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.980 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.980 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.980 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.980 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.980 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.981 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.981 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.981 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.981 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.981 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.981 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.981 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.982 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.982 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.982 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.982 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.982 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.983 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.983 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.983 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:37.983 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:40:37.983 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:37.984 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.984 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.984 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.984 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.984 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.984 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.985 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.985 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.985 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.985 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.985 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:37.986 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.986 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:37.986 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.986 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.986 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.986 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.987 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:37.987 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:37.987 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.987 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.987 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.988 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.988 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.988 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.989 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.989 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.989 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.989 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.989 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.989 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.990 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.990 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.990 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.990 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.990 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.991 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:37.991 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.991 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.991 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.991 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.991 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.992 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.992 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.992 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.992 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.992 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.992 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.993 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.993 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.993 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.993 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.993 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.993 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.994 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.994 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.994 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:37.994 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:37.994 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:40:37.995 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:37.995 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.995 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.995 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.995 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:37.995 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.996 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:37.996 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.996 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.996 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.996 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.996 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:37.996 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:37.997 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:37.997 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.997 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:37.997 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:37.997 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:37.997 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:37.998 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:37.998 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.998 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:37.998 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:37.998 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:37.998 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:37.999 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:37.999 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:37.999 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:37.999 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:37.999 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:37.999 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.000 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.000 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.000 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.000 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.000 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.001 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.001 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.001 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.001 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.001 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.001 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.002 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.002 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.002 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.002 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.002 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.002 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.003 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.003 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.003 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.003 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.003 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.004 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.004 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.004 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.004 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.004 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.004 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.005 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:40:38.005 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:38.005 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.005 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.005 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.006 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.006 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.006 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.006 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.006 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.006 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.007 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.007 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.007 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.007 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.007 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.007 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.008 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.008 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.008 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.008 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.008 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.009 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.009 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.009 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.009 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.009 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.009 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.010 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.010 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.010 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.010 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.010 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.011 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.011 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.011 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.011 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.011 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.011 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.012 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.012 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.012 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.012 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.013 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.013 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.013 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.013 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.013 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.013 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.014 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.014 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.014 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.014 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.014 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.014 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.015 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.015 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.015 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.015 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.015 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:38.015 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:40:38.015 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.016 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.016 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.016 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.016 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.016 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.016 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.016 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.017 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.017 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.017 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.017 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.017 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.017 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.017 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.018 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.018 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.018 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.018 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.018 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.018 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.019 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.019 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.019 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.019 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.019 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.019 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.019 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.020 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.020 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.020 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.020 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.020 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.020 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.020 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.021 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.021 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.021 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.021 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.021 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.021 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.021 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.022 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.022 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.022 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.022 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.022 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.022 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.023 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.023 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.023 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.023 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.023 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.023 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.024 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.024 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.024 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.024 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.024 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.024 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:40:38.024 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.025 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.025 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.025 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.025 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.025 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.025 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.025 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.026 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.026 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.026 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.026 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.026 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.026 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.027 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.027 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.027 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.027 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.027 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.027 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.027 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.028 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.028 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.028 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.028 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.028 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.028 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.029 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.029 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.029 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.029 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.029 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.029 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.029 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.030 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.030 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.030 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.030 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.030 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.030 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.031 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.031 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.031 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.031 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.031 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.031 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.031 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.032 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.032 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.032 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.032 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.032 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.032 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.033 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.033 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.033 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.033 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.033 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.033 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:38.033 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj_", 2020-04-28T12:40:38.034 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.034 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.034 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.034 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.034 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.034 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.034 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.035 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.036 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.037 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.037 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.037 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.037 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.037 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.037 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.037 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.038 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.038 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.038 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.038 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.038 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.039 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.039 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.039 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.039 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.039 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.039 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.039 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.040 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.040 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.040 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.040 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.040 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.040 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.040 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.041 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.041 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.041 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.041 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.041 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.041 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.041 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.042 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.042 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.042 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.042 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj_", 2020-04-28T12:40:38.042 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.042 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.042 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.043 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.043 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.043 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.043 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.043 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.043 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.043 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.044 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.044 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.044 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.044 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.045 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.045 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.045 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.045 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.045 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.045 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.045 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.046 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.046 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.046 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.046 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.046 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.046 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.046 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.047 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.047 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.047 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.047 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.047 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.047 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.047 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.048 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.048 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.048 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.048 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.048 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.048 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.048 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.049 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.049 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.049 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.049 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.049 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.049 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.049 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.050 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.050 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.050 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.050 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.050 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.050 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.050 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.051 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.051 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.051 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:38.051 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:40:38.051 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.051 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.051 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.052 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.052 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.052 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.052 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.052 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.052 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.053 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.053 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.053 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.053 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.053 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.053 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.053 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.054 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.054 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.054 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.054 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.054 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.054 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.054 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.055 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.055 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.055 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.055 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.055 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.055 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.056 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.056 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.056 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.056 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.056 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.056 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.056 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.057 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.057 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.057 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.057 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.057 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.057 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.057 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.058 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.058 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.058 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.058 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.058 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.058 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.059 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.059 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.059 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.059 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.059 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.059 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.059 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.060 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.060 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.060 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.060 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:40:38.060 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.060 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.061 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.061 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.061 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.061 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.061 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.061 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.061 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.062 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.062 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.062 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.062 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.062 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.062 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.063 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.063 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.063 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.063 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.063 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.063 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.063 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.064 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.064 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.064 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.064 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.064 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.064 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.064 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.065 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.065 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.065 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.065 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.066 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.066 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.066 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.066 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.066 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.066 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.066 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.067 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.067 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.067 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.067 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.067 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.067 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.068 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.068 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.068 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.068 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.068 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.068 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.068 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.069 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.069 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.069 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.070 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.070 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.070 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:38.070 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:40:38.071 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.071 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.071 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.071 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.072 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.072 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.072 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.072 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.072 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.072 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.072 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.073 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.073 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.073 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.073 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.073 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.073 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.073 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.074 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.074 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.074 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.074 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.074 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.074 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.075 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.075 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.075 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.075 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.075 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.075 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.075 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.076 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.076 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.076 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.076 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.076 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.076 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.076 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.077 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.077 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.077 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.077 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.077 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.078 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.078 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.078 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.078 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.078 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.078 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.078 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.079 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.079 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.079 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.079 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.079 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.079 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.079 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.080 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.081 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.081 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.081 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.081 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.081 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.081 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.081 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.082 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.082 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.082 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.082 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.082 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.082 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.083 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.084 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.084 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.084 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.084 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.084 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.084 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.084 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.085 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.085 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.085 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.085 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.085 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.085 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.085 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.086 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.086 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.086 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.086 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.087 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.087 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.087 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.087 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.087 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.088 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.088 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.088 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.088 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.088 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.089 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.089 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.089 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.090 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.090 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": "default-placement.data", 2020-04-28T12:40:38.090 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:40:38.090 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.090 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.090 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.091 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.091 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.091 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.091 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "test", 2020-04-28T12:40:38.091 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.092 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.092 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.092 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.092 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": "", 2020-04-28T12:40:38.092 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.092 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": "" 2020-04-28T12:40:38.093 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.093 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.093 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.093 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.093 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.094 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.094 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.094 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.094 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.094 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.094 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.094 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.095 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.095 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.095 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.095 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.095 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.096 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.096 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.096 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.096 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.096 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.097 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.097 INFO:tasks.workunit.client.0.smithi197.stdout: "obj": { 2020-04-28T12:40:38.098 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.098 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.098 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.098 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.098 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.098 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.098 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.099 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.099 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.099 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.099 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.099 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.099 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.099 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.100 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.100 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.101 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.101 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.101 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.101 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.101 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.101 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:40:38.102 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.102 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.102 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.102 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.102 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.102 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.102 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.103 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.103 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.103 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.104 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.104 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.104 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.104 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.104 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.104 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.104 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.105 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.105 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.105 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.105 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.105 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.105 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.105 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2020-04-28T12:40:38.106 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] TestRGWObj.old_to_raw 2020-04-28T12:40:38.106 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.106 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.106 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.106 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker_myobj", 2020-04-28T12:40:38.106 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.106 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.107 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.107 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.107 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.107 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.107 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.107 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.107 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.108 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.108 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.108 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.108 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.108 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.108 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.109 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.109 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.109 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.109 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.109 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.109 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.109 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.110 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.110 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker_myobj 2020-04-28T12:40:38.110 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.110 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.110 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.110 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker_myobj", 2020-04-28T12:40:38.110 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.111 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.111 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.111 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.111 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.111 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.111 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.111 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.112 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.112 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.112 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.112 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.112 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.112 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.112 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.113 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.113 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.113 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.113 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.113 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.113 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.114 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.114 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.114 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker_myobj 2020-04-28T12:40:38.114 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.114 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.114 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.114 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:40:38.115 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.115 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.115 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.115 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.115 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.115 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.115 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.116 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.116 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.116 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.116 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.116 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.116 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.117 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.117 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.117 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.117 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.117 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.117 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.117 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.118 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.118 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.118 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.118 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__ns_myobj 2020-04-28T12:40:38.118 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.118 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.119 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.119 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:40:38.119 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.119 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.119 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.119 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.119 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.120 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.120 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.120 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.120 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.120 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.120 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.121 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.122 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.122 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.122 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.122 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.122 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__ns_myobj 2020-04-28T12:40:38.122 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.123 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.123 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.123 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:40:38.123 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.123 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.123 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.124 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.124 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.124 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.124 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.124 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.124 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.124 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.125 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.125 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.125 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.125 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.125 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.125 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.125 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.126 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.126 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.126 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.126 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.126 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.126 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.126 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__:inst_myobj 2020-04-28T12:40:38.127 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.127 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.127 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.127 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:40:38.127 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.127 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.127 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.128 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.128 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.128 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.128 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.128 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.128 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.128 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.129 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.129 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.129 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.129 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.129 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.129 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.129 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.130 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.130 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.130 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.130 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.130 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.130 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.131 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__:inst_myobj 2020-04-28T12:40:38.131 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.131 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.131 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.131 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:40:38.131 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.131 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.132 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.132 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.132 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.132 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.132 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.132 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.132 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.133 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.133 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.133 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.133 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.133 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.133 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.133 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.134 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.134 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.134 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.134 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.134 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.134 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.134 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.135 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__ns:inst_myobj 2020-04-28T12:40:38.135 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.135 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.135 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.135 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:40:38.135 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.136 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.136 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.136 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.136 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.136 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.136 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.136 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.137 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.137 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.137 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.137 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.137 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.137 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.137 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.138 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.138 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.138 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "myobj", 2020-04-28T12:40:38.138 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.138 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.138 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.139 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.139 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.139 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__ns:inst_myobj 2020-04-28T12:40:38.139 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.139 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.139 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.140 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj", 2020-04-28T12:40:38.140 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:38.140 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.140 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.140 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.140 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.141 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.141 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.141 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.141 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.141 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.141 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.141 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.142 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.142 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.142 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.142 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.142 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.142 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.142 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.143 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.143 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.143 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.143 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.143 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker___myobj 2020-04-28T12:40:38.143 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.144 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.144 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.144 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj", 2020-04-28T12:40:38.144 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:38.144 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.144 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.145 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.145 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.145 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.145 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.145 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.145 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.146 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.146 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.146 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.146 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.146 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.146 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.147 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.148 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker___myobj 2020-04-28T12:40:38.148 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.148 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.148 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.148 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:40:38.148 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.149 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.149 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.149 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.149 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.149 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.149 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.149 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.150 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.150 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.150 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.150 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.150 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.150 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.150 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.151 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.151 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.151 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.151 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.151 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.151 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.152 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.152 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.152 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__ns__myobj 2020-04-28T12:40:38.152 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.152 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.152 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.153 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:40:38.153 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.153 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.153 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.153 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.153 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.154 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.154 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.154 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.154 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.154 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.154 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.155 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.156 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.156 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.156 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.156 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.156 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.156 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.156 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.157 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.157 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.157 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.157 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.157 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__ns__myobj 2020-04-28T12:40:38.157 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.157 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.158 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.158 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:40:38.158 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:38.158 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.158 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.158 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.159 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.159 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.159 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.159 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.159 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.159 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.159 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.160 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.160 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.160 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.160 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.160 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.160 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.160 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.161 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.161 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.161 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.161 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.161 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.161 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__:inst__myobj 2020-04-28T12:40:38.161 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.162 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.162 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.162 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:40:38.162 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj" 2020-04-28T12:40:38.162 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.162 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.162 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.163 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.163 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.163 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.163 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.163 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.163 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.163 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.164 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.164 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.164 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.164 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.164 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.164 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.164 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__:inst__myobj 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.165 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.166 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.166 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:40:38.166 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.166 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.166 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.166 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.166 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.167 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.167 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.167 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.167 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.167 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.167 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.167 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.168 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.168 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.168 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.168 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.168 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.168 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__ns:inst__myobj 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.169 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.170 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.170 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:40:38.170 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.170 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.170 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.171 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.171 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.171 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.171 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.171 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.171 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.171 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.172 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.172 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.172 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.172 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.172 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.172 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.172 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.173 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj", 2020-04-28T12:40:38.173 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.173 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.173 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.173 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.173 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.173 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__ns:inst__myobj 2020-04-28T12:40:38.174 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.174 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.174 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.174 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj_", 2020-04-28T12:40:38.174 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.174 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.174 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.175 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.175 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.175 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.175 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.175 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.175 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.175 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.176 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.176 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.176 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.176 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.176 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.176 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.176 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.177 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.177 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.177 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.177 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.177 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.177 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.177 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker___myobj_ 2020-04-28T12:40:38.178 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.178 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.178 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.178 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker___myobj_", 2020-04-28T12:40:38.178 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.178 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.178 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.179 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.179 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.179 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.179 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.179 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.179 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.179 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.180 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.180 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.180 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.180 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.180 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.180 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.180 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.181 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.181 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.181 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.181 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.181 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.181 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.181 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker___myobj_ 2020-04-28T12:40:38.182 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.182 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.182 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.182 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:40:38.182 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.182 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.182 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.183 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.183 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.183 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.183 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.183 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.183 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.183 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.184 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.184 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.184 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.184 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.184 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.184 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.184 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.185 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.185 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.185 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.185 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.185 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.185 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.185 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__ns__myobj_ 2020-04-28T12:40:38.186 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.186 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.186 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.186 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:40:38.186 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.186 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.186 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.187 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.187 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.187 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.187 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.187 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.187 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.188 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.188 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.188 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.188 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.188 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.188 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.189 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.189 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.189 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.189 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "", 2020-04-28T12:40:38.189 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.189 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.189 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.190 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.190 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__ns__myobj_ 2020-04-28T12:40:38.190 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.190 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.190 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.190 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:40:38.191 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.191 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.191 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.191 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.191 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.191 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.191 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.192 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.192 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.192 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.192 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.192 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.192 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.193 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.193 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.193 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.193 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.193 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.193 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.194 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.194 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.194 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.194 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.194 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__:inst__myobj_ 2020-04-28T12:40:38.194 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.194 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.195 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.195 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:40:38.195 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "marker__myobj_" 2020-04-28T12:40:38.195 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.195 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.195 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.195 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.196 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.196 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.196 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.196 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.196 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.197 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.197 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.197 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.197 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.197 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.198 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.198 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.198 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.198 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.198 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "" 2020-04-28T12:40:38.198 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.198 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.199 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.199 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__:inst__myobj_ 2020-04-28T12:40:38.199 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.199 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj": { 2020-04-28T12:40:38.199 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.199 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:40:38.199 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.200 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.200 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.200 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.200 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj": { 2020-04-28T12:40:38.200 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.200 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.200 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.201 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.201 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.201 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.201 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.201 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.201 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.201 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.202 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.202 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.202 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.202 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.202 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.202 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.203 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.203 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.203 INFO:tasks.workunit.client.0.smithi197.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:40:38.203 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.203 INFO:tasks.workunit.client.0.smithi197.stdout: "raw_obj2": { 2020-04-28T12:40:38.203 INFO:tasks.workunit.client.0.smithi197.stdout: "pool": ".data-pool", 2020-04-28T12:40:38.203 INFO:tasks.workunit.client.0.smithi197.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:40:38.204 INFO:tasks.workunit.client.0.smithi197.stdout: "loc": "" 2020-04-28T12:40:38.204 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.204 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.204 INFO:tasks.workunit.client.0.smithi197.stdout:{ 2020-04-28T12:40:38.204 INFO:tasks.workunit.client.0.smithi197.stdout: "new_obj2": { 2020-04-28T12:40:38.204 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket": { 2020-04-28T12:40:38.204 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "ebtest", 2020-04-28T12:40:38.205 INFO:tasks.workunit.client.0.smithi197.stdout: "marker": "marker", 2020-04-28T12:40:38.205 INFO:tasks.workunit.client.0.smithi197.stdout: "bucket_id": "bucket-id", 2020-04-28T12:40:38.205 INFO:tasks.workunit.client.0.smithi197.stdout: "tenant": "", 2020-04-28T12:40:38.205 INFO:tasks.workunit.client.0.smithi197.stdout: "explicit_placement": { 2020-04-28T12:40:38.205 INFO:tasks.workunit.client.0.smithi197.stdout: "data_pool": ".data-pool", 2020-04-28T12:40:38.205 INFO:tasks.workunit.client.0.smithi197.stdout: "data_extra_pool": "", 2020-04-28T12:40:38.205 INFO:tasks.workunit.client.0.smithi197.stdout: "index_pool": ".index-pool" 2020-04-28T12:40:38.206 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.206 INFO:tasks.workunit.client.0.smithi197.stdout: }, 2020-04-28T12:40:38.206 INFO:tasks.workunit.client.0.smithi197.stdout: "key": { 2020-04-28T12:40:38.206 INFO:tasks.workunit.client.0.smithi197.stdout: "name": "_myobj_", 2020-04-28T12:40:38.206 INFO:tasks.workunit.client.0.smithi197.stdout: "instance": "inst", 2020-04-28T12:40:38.206 INFO:tasks.workunit.client.0.smithi197.stdout: "ns": "ns" 2020-04-28T12:40:38.206 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.207 INFO:tasks.workunit.client.0.smithi197.stdout: } 2020-04-28T12:40:38.207 INFO:tasks.workunit.client.0.smithi197.stdout:} 2020-04-28T12:40:38.207 INFO:tasks.workunit.client.0.smithi197.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:40:38.207 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2020-04-28T12:40:38.207 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2020-04-28T12:40:38.207 INFO:tasks.workunit.client.0.smithi197.stdout: 2020-04-28T12:40:38.207 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment tear-down 2020-04-28T12:40:38.208 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2020-04-28T12:40:38.208 INFO:tasks.workunit.client.0.smithi197.stdout:[ PASSED ] 4 tests. 2020-04-28T12:40:38.208 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:38.223 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:40:38.224 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:40:38.299 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_throttle.sh on client.0... 2020-04-28T12:40:38.299 INFO:tasks.workunit:Running workunit rgw/test_rgw_throttle.sh... 2020-04-28T12:40:38.300 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:38.347 INFO:teuthology.orchestra.run.smithi197:workunit test rgw/test_rgw_throttle.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh 2020-04-28T12:40:38.425 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:40:38.425 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment set-up. 2020-04-28T12:40:40.467 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 5 tests from Aio_Throttle 2020-04-28T12:40:40.467 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] Aio_Throttle.NoThrottleUpToMax 2020-04-28T12:40:40.467 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] Aio_Throttle.NoThrottleUpToMax (0 ms) 2020-04-28T12:40:40.467 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] Aio_Throttle.CostOverWindow 2020-04-28T12:40:40.468 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] Aio_Throttle.CostOverWindow (0 ms) 2020-04-28T12:40:40.468 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] Aio_Throttle.ThrottleOverMax 2020-04-28T12:40:40.554 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] Aio_Throttle.ThrottleOverMax (88 ms) 2020-04-28T12:40:40.555 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] Aio_Throttle.YieldCostOverWindow 2020-04-28T12:40:40.555 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] Aio_Throttle.YieldCostOverWindow (0 ms) 2020-04-28T12:40:40.555 INFO:tasks.workunit.client.0.smithi197.stdout:[ RUN ] Aio_Throttle.YieldingThrottleOverMax 2020-04-28T12:40:40.642 INFO:tasks.workunit.client.0.smithi197.stdout:[ OK ] Aio_Throttle.YieldingThrottleOverMax (88 ms) 2020-04-28T12:40:40.643 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] 5 tests from Aio_Throttle (176 ms total) 2020-04-28T12:40:40.643 INFO:tasks.workunit.client.0.smithi197.stdout: 2020-04-28T12:40:40.643 INFO:tasks.workunit.client.0.smithi197.stdout:[----------] Global test environment tear-down 2020-04-28T12:40:40.643 INFO:tasks.workunit.client.0.smithi197.stdout:[==========] 5 tests from 1 test suite ran. (2218 ms total) 2020-04-28T12:40:40.643 INFO:tasks.workunit.client.0.smithi197.stdout:[ PASSED ] 5 tests. 2020-04-28T12:40:40.646 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:40.701 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:40:40.701 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:40:40.777 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh'] on client.0... 2020-04-28T12:40:40.777 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:40.824 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-04-28T12:40:41.040 DEBUG:teuthology.parallel:result is None 2020-04-28T12:40:41.040 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:41.053 INFO:teuthology.orchestra.run.smithi197:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:40:41.120 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:40:41.121 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:41.174 INFO:teuthology.orchestra.run.smithi197:> rmdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:40:41.230 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:40:41.231 INFO:teuthology.run_tasks:Running task ragweed... 2020-04-28T12:40:41.245 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2020-04-28T12:40:41.245 INFO:tasks.ragweed:Downloading ragweed... 2020-04-28T12:40:41.245 INFO:tasks.ragweed:Using branch 'octopus' for ragweed 2020-04-28T12:40:41.245 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:41.284 INFO:teuthology.orchestra.run.smithi197:> git clone -b octopus git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:40:41.338 INFO:teuthology.orchestra.run.smithi197.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:40:41.349 INFO:teuthology.orchestra.run.smithi197.stderr:fatal: Remote branch octopus not found in upstream origin 2020-04-28T12:40:41.350 DEBUG:teuthology.orchestra.run:got remote process result: 128 2020-04-28T12:40:41.351 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:41.404 INFO:teuthology.orchestra.run.smithi197:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:40:41.458 INFO:teuthology.orchestra.run.smithi197.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:40:41.601 INFO:tasks.ragweed:Creating rgw users... 2020-04-28T12:40:41.602 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2020-04-28T12:40:41.602 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:41.655 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key FMKOFNYXKFWENWPJDOXN --secret lxer9Dt241nPYNgdrGvRl/Z4UsKB7XDSKbZ98HF+OG2s7JSLFdZZWQ== --email sysuser.client.0+test@test.test --system true 2020-04-28T12:40:41.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.742+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.749 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.745+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.749 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.745+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.752 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.748+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.752 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.748+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.752 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.749+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.753 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.749+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.754+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:41.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.771+0000 7fcba19ed180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:40:41.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.771+0000 7fcba19ed180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:40:41.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.771+0000 7fcba19ed180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:40:41.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.771+0000 7fcba19ed180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:40:41.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.771+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.772+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:41.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.772+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.772+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:40:41.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.773+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.773+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:41.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.773+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.774+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:40:41.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.774+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.774+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.774+0000 7fcba19ed180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:40:41.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.774+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.774+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.774+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.775+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:41.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.775+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.775+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:40:41.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.775+0000 7fcba19ed180 20 zonegroup default 2020-04-28T12:40:41.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.775+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.776+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.776+0000 7fcba19ed180 10 Cannot find current period zone using local zone 2020-04-28T12:40:41.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.776+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.776+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.776+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.777+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:41.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.777+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.777+0000 7fcba19ed180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:40:41.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.777+0000 7fcba19ed180 20 zone default found 2020-04-28T12:40:41.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.777+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.778+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.778+0000 7fcba19ed180 20 rados->read ofs=0 len=0 2020-04-28T12:40:41.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.778+0000 7fcba19ed180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:41.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.778+0000 7fcba19ed180 20 started sync module instance, tier type = 2020-04-28T12:40:41.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.778+0000 7fcba19ed180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:40:41.789 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.779+0000 7fcb901e2700 0 -- 172.21.15.197:0/1150166366 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7fcb8403f450 msgr2=0x7fcb8403eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:40:41.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.789+0000 7fcba19ed180 20 add_watcher() i=0 2020-04-28T12:40:41.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.789+0000 7fcba19ed180 20 add_watcher() i=1 2020-04-28T12:40:41.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.789+0000 7fcba19ed180 20 add_watcher() i=2 2020-04-28T12:40:41.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.789+0000 7fcba19ed180 20 add_watcher() i=3 2020-04-28T12:40:41.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.789+0000 7fcba19ed180 20 add_watcher() i=4 2020-04-28T12:40:41.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.789+0000 7fcba19ed180 20 add_watcher() i=5 2020-04-28T12:40:41.794 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.789+0000 7fcba19ed180 20 add_watcher() i=6 2020-04-28T12:40:41.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.790+0000 7fcba19ed180 20 add_watcher() i=7 2020-04-28T12:40:41.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.790+0000 7fcba19ed180 2 all 8 watchers are set, enabling cache 2020-04-28T12:40:41.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.790+0000 7fcba19ed180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:40:41.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.790+0000 7fcba19ed180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:40:41.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.790+0000 7fcae3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:40:41.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.791+0000 7fcb901e2700 0 -- 172.21.15.197:0/7016450 >> v2:172.21.15.197:3300/0 conn(0x55bb3d72d890 msgr2=0x55bb3d72dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:40:41.995 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:41.992+0000 7fcb901e2700 0 --2- 172.21.15.197:0/7016450 >> v2:172.21.15.197:3300/0 conn(0x55bb3d72d890 0x55bb3d72dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-04-28T12:40:42.048 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.044+0000 7fcace7fc700 20 reqs_thread_entry: start 2020-04-28T12:40:42.049 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.044+0000 7fcaccff9700 20 reqs_thread_entry: start 2020-04-28T12:40:42.049 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcba19ed180 20 init_complete bucket index max shards: 1999 2020-04-28T12:40:42.049 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcba19ed180 20 get_system_obj_state: rctx=0x7fff984bfc88 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55bb3d5d9040 s->prefetch_data=0 2020-04-28T12:40:42.049 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcba19ed180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:40:42.049 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcac67fc700 20 reqs_thread_entry: start 2020-04-28T12:40:42.050 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2020-04-28T12:40:42.051 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcba19ed180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:40:42.051 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcba19ed180 20 get_system_obj_state: rctx=0x7fff984bfc98 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x55bb3d5d9040 s->prefetch_data=0 2020-04-28T12:40:42.051 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.045+0000 7fcba19ed180 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2020-04-28T12:40:42.051 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2020-04-28T12:40:42.051 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:40:42.051 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 20 get_system_obj_state: rctx=0x7fff984bfc98 obj=default.rgw.meta:users.keys:FMKOFNYXKFWENWPJDOXN state=0x55bb3d5d9040 s->prefetch_data=0 2020-04-28T12:40:42.051 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 cache get: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN : miss 2020-04-28T12:40:42.052 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN info.flags=0x0 2020-04-28T12:40:42.052 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 adding default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN to cache LRU end 2020-04-28T12:40:42.052 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 20 get_system_obj_state: rctx=0x7fff984bf6a8 obj=default.rgw.meta:users.keys:FMKOFNYXKFWENWPJDOXN state=0x55bb3d5d9040 s->prefetch_data=0 2020-04-28T12:40:42.052 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 cache get: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN : type miss (requested=0x6, cached=0x0) 2020-04-28T12:40:42.052 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN info.flags=0x0 2020-04-28T12:40:42.052 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 moving default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN to cache LRU end 2020-04-28T12:40:42.052 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 20 get_system_obj_state: rctx=0x7fff984bf998 obj=default.rgw.meta:users.keys:FMKOFNYXKFWENWPJDOXN state=0x55bb3d5d9040 s->prefetch_data=0 2020-04-28T12:40:42.053 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.046+0000 7fcba19ed180 10 cache get: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN : type miss (requested=0x6, cached=0x0) 2020-04-28T12:40:42.053 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.047+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN info.flags=0x0 2020-04-28T12:40:42.053 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.047+0000 7fcba19ed180 10 moving default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN to cache LRU end 2020-04-28T12:40:42.053 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.048+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:40:42.054 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.048+0000 7fcba19ed180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:40:42.054 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.048+0000 7fcba19ed180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2020-04-28T12:40:42.054 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.049+0000 7fcb757fa700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94262678119552 notifier 4831 bl.length()=637 2020-04-28T12:40:42.054 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.049+0000 7fcb757fa700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:40:42.054 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.049+0000 7fcb757fa700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:40:42.055 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.051+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:40:42.055 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.051+0000 7fcba19ed180 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:40:42.055 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.051+0000 7fcba19ed180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2020-04-28T12:40:42.056 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.052+0000 7fcb757fa700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94262678124016 notifier 4831 bl.length()=202 2020-04-28T12:40:42.056 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.052+0000 7fcb757fa700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:40:42.056 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.052+0000 7fcb757fa700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:40:42.058 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.054+0000 7fcba19ed180 10 cache put: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN info.flags=0x7 2020-04-28T12:40:42.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.054+0000 7fcba19ed180 10 moving default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN to cache LRU end 2020-04-28T12:40:42.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.054+0000 7fcba19ed180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=190 2020-04-28T12:40:42.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.054+0000 7fcb757fa700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94262678132560 notifier 4831 bl.length()=190 2020-04-28T12:40:42.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.054+0000 7fcb757fa700 10 cache put: name=default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN info.flags=0x7 2020-04-28T12:40:42.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.054+0000 7fcb757fa700 10 moving default.rgw.meta+users.keys+FMKOFNYXKFWENWPJDOXN to cache LRU end 2020-04-28T12:40:42.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.055+0000 7fcae3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout:{ 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout: "user_id": "sysuser.client.0", 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout: "display_name": "Mr. sysuser.client.0", 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout: "email": "sysuser.client.0+test@test.test", 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout: "suspended": 0, 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout: "max_buckets": 1000, 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout: "subusers": [], 2020-04-28T12:40:42.060 INFO:teuthology.orchestra.run.smithi197.stdout: "keys": [ 2020-04-28T12:40:42.061 INFO:teuthology.orchestra.run.smithi197.stdout: { 2020-04-28T12:40:42.061 INFO:teuthology.orchestra.run.smithi197.stdout: "user": "sysuser.client.0", 2020-04-28T12:40:42.061 INFO:teuthology.orchestra.run.smithi197.stdout: "access_key": "FMKOFNYXKFWENWPJDOXN", 2020-04-28T12:40:42.061 INFO:teuthology.orchestra.run.smithi197.stdout: "secret_key": "lxer9Dt241nPYNgdrGvRl/Z4UsKB7XDSKbZ98HF+OG2s7JSLFdZZWQ==" 2020-04-28T12:40:42.061 INFO:teuthology.orchestra.run.smithi197.stdout: } 2020-04-28T12:40:42.061 INFO:teuthology.orchestra.run.smithi197.stdout: ], 2020-04-28T12:40:42.061 INFO:teuthology.orchestra.run.smithi197.stdout: "swift_keys": [], 2020-04-28T12:40:42.062 INFO:teuthology.orchestra.run.smithi197.stdout: "caps": [], 2020-04-28T12:40:42.062 INFO:teuthology.orchestra.run.smithi197.stdout: "op_mask": "read, write, delete", 2020-04-28T12:40:42.062 INFO:teuthology.orchestra.run.smithi197.stdout: "system": "true", 2020-04-28T12:40:42.062 INFO:teuthology.orchestra.run.smithi197.stdout: "default_placement": "", 2020-04-28T12:40:42.062 INFO:teuthology.orchestra.run.smithi197.stdout: "default_storage_class": "", 2020-04-28T12:40:42.062 INFO:teuthology.orchestra.run.smithi197.stdout: "placement_tags": [], 2020-04-28T12:40:42.062 INFO:teuthology.orchestra.run.smithi197.stdout: "bucket_quota": { 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: "enabled": false, 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: "check_on_raw": false, 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size": -1, 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size_kb": 0, 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: "max_objects": -1 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: }, 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: "user_quota": { 2020-04-28T12:40:42.063 INFO:teuthology.orchestra.run.smithi197.stdout: "enabled": false, 2020-04-28T12:40:42.064 INFO:teuthology.orchestra.run.smithi197.stdout: "check_on_raw": false, 2020-04-28T12:40:42.064 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size": -1, 2020-04-28T12:40:42.064 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size_kb": 0, 2020-04-28T12:40:42.064 INFO:teuthology.orchestra.run.smithi197.stdout: "max_objects": -1 2020-04-28T12:40:42.064 INFO:teuthology.orchestra.run.smithi197.stdout: }, 2020-04-28T12:40:42.064 INFO:teuthology.orchestra.run.smithi197.stdout: "temp_url_keys": [], 2020-04-28T12:40:42.064 INFO:teuthology.orchestra.run.smithi197.stdout: "type": "rgw", 2020-04-28T12:40:42.065 INFO:teuthology.orchestra.run.smithi197.stdout: "mfa_ids": [] 2020-04-28T12:40:42.065 INFO:teuthology.orchestra.run.smithi197.stdout:} 2020-04-28T12:40:42.065 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:40:42.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.056+0000 7fcba19ed180 20 remove_watcher() i=0 2020-04-28T12:40:42.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.056+0000 7fcba19ed180 2 removed watcher, disabling cache 2020-04-28T12:40:42.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.058+0000 7fcba19ed180 20 remove_watcher() i=1 2020-04-28T12:40:42.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.059+0000 7fcba19ed180 20 remove_watcher() i=2 2020-04-28T12:40:42.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.060+0000 7fcba19ed180 20 remove_watcher() i=3 2020-04-28T12:40:42.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.062+0000 7fcba19ed180 20 remove_watcher() i=4 2020-04-28T12:40:42.067 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.063+0000 7fcba19ed180 20 remove_watcher() i=5 2020-04-28T12:40:42.071 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.064+0000 7fcba19ed180 20 remove_watcher() i=6 2020-04-28T12:40:42.071 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.065+0000 7fcba19ed180 20 remove_watcher() i=7 2020-04-28T12:40:42.073 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2020-04-28T12:40:42.073 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:42.086 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key CSWNFZXWAAGDRFVJFXNK --secret SmKBVzeHbmC7/xLbP9nwuv4Oap5bYzOQBXTgvIQrz1AXrk/frRwI3Q== --email ragweed.client.0+test@test.test --system false 2020-04-28T12:40:42.175 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.172+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.177 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.173+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.177 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.173+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.177 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.174+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.178 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.174+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.178 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.174+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.178 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.174+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.179 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.176+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:42.195 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.192+0000 7f5594c19180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:40:42.196 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.192+0000 7f5594c19180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:40:42.196 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.192+0000 7f5594c19180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:40:42.196 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.192+0000 7f5594c19180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:40:42.196 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.192+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.197 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.192+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:42.197 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.192+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.197 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.193+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:40:42.197 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.193+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.197 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.193+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:42.198 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.193+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.198 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.194+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:40:42.198 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.194+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.199 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.194+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.199 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.194+0000 7f5594c19180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:40:42.199 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.194+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.199 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.195+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.199 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.195+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.200 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.195+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:42.200 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.195+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:40:42.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 20 zonegroup default 2020-04-28T12:40:42.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 10 Cannot find current period zone using local zone 2020-04-28T12:40:42.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.196+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.197+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:40:42.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.197+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.197+0000 7f5594c19180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:40:42.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.197+0000 7f5594c19180 20 zone default found 2020-04-28T12:40:42.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.197+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.198+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.198+0000 7f5594c19180 20 rados->read ofs=0 len=0 2020-04-28T12:40:42.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.198+0000 7f5594c19180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:40:42.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.198+0000 7f5594c19180 20 started sync module instance, tier type = 2020-04-28T12:40:42.205 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.198+0000 7f5594c19180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:40:42.205 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.199+0000 7f558340e700 0 -- 172.21.15.197:0/1118177918 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f557400b270 msgr2=0x7f55740084d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:40:42.212 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.209+0000 7f5594c19180 20 add_watcher() i=0 2020-04-28T12:40:42.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.209+0000 7f5594c19180 20 add_watcher() i=1 2020-04-28T12:40:42.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.209+0000 7f5594c19180 20 add_watcher() i=2 2020-04-28T12:40:42.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.209+0000 7f5594c19180 20 add_watcher() i=3 2020-04-28T12:40:42.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.209+0000 7f5594c19180 20 add_watcher() i=4 2020-04-28T12:40:42.214 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.209+0000 7f5594c19180 20 add_watcher() i=5 2020-04-28T12:40:42.214 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.209+0000 7f5594c19180 20 add_watcher() i=6 2020-04-28T12:40:42.214 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.210+0000 7f5594c19180 20 add_watcher() i=7 2020-04-28T12:40:42.215 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.210+0000 7f5594c19180 2 all 8 watchers are set, enabling cache 2020-04-28T12:40:42.215 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.210+0000 7f5594c19180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:40:42.215 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.210+0000 7f5594c19180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:40:42.215 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.210+0000 7f55537de700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:40:42.215 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.211+0000 7f558240c700 0 -- 172.21.15.197:0/3971577239 >> v2:172.21.15.66:3300/0 conn(0x565089bd4800 msgr2=0x565089bd6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:40:42.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.257+0000 7f54c1ffb700 20 reqs_thread_entry: start 2020-04-28T12:40:42.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.258+0000 7f54bb7fe700 20 reqs_thread_entry: start 2020-04-28T12:40:42.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.258+0000 7f5594c19180 20 init_complete bucket index max shards: 1999 2020-04-28T12:40:42.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.258+0000 7f54b9ffb700 20 reqs_thread_entry: start 2020-04-28T12:40:42.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.258+0000 7f5594c19180 20 get_system_obj_state: rctx=0x7ffc0584e968 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x565089a77040 s->prefetch_data=0 2020-04-28T12:40:42.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.258+0000 7f5594c19180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:40:42.264 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2020-04-28T12:40:42.264 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:40:42.264 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 20 get_system_obj_state: rctx=0x7ffc0584e978 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x565089a77040 s->prefetch_data=0 2020-04-28T12:40:42.264 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2020-04-28T12:40:42.264 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2020-04-28T12:40:42.265 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:40:42.265 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 20 get_system_obj_state: rctx=0x7ffc0584e978 obj=default.rgw.meta:users.keys:CSWNFZXWAAGDRFVJFXNK state=0x565089a77040 s->prefetch_data=0 2020-04-28T12:40:42.265 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 cache get: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK : miss 2020-04-28T12:40:42.265 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK info.flags=0x0 2020-04-28T12:40:42.265 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 adding default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK to cache LRU end 2020-04-28T12:40:42.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 20 get_system_obj_state: rctx=0x7ffc0584e388 obj=default.rgw.meta:users.keys:CSWNFZXWAAGDRFVJFXNK state=0x565089a77040 s->prefetch_data=0 2020-04-28T12:40:42.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.259+0000 7f5594c19180 10 cache get: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK : type miss (requested=0x6, cached=0x0) 2020-04-28T12:40:42.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.260+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK info.flags=0x0 2020-04-28T12:40:42.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.260+0000 7f5594c19180 10 moving default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK to cache LRU end 2020-04-28T12:40:42.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.260+0000 7f5594c19180 20 get_system_obj_state: rctx=0x7ffc0584e678 obj=default.rgw.meta:users.keys:CSWNFZXWAAGDRFVJFXNK state=0x565089a77040 s->prefetch_data=0 2020-04-28T12:40:42.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.260+0000 7f5594c19180 10 cache get: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK : type miss (requested=0x6, cached=0x0) 2020-04-28T12:40:42.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.260+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK info.flags=0x0 2020-04-28T12:40:42.267 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.260+0000 7f5594c19180 10 moving default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK to cache LRU end 2020-04-28T12:40:42.267 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.261+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:40:42.267 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.261+0000 7f5594c19180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:40:42.268 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.262+0000 7f5594c19180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2020-04-28T12:40:42.268 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.262+0000 7f5563fff700 10 RGWWatcher::handle_notify() notify_id 506806140929 cookie 94903908160160 notifier 4529 bl.length()=637 2020-04-28T12:40:42.268 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.262+0000 7f5563fff700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:40:42.268 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.262+0000 7f5563fff700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:40:42.269 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.264+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:40:42.269 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.264+0000 7f5594c19180 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:40:42.269 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.264+0000 7f5594c19180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2020-04-28T12:40:42.269 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.265+0000 7f5563fff700 10 RGWWatcher::handle_notify() notify_id 506806140929 cookie 94903908149616 notifier 4529 bl.length()=202 2020-04-28T12:40:42.269 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.265+0000 7f5563fff700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:40:42.270 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.265+0000 7f5563fff700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:40:42.270 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.267+0000 7f5594c19180 10 cache put: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK info.flags=0x7 2020-04-28T12:40:42.270 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.267+0000 7f5594c19180 10 moving default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK to cache LRU end 2020-04-28T12:40:42.270 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.267+0000 7f5594c19180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=190 2020-04-28T12:40:42.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.267+0000 7f5563fff700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94903908164112 notifier 4529 bl.length()=190 2020-04-28T12:40:42.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.267+0000 7f5563fff700 10 cache put: name=default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK info.flags=0x7 2020-04-28T12:40:42.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.267+0000 7f5563fff700 10 moving default.rgw.meta+users.keys+CSWNFZXWAAGDRFVJFXNK to cache LRU end 2020-04-28T12:40:42.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.268+0000 7f55537de700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:40:42.272 INFO:teuthology.orchestra.run.smithi197.stdout:{ 2020-04-28T12:40:42.272 INFO:teuthology.orchestra.run.smithi197.stdout: "user_id": "ragweed.client.0", 2020-04-28T12:40:42.272 INFO:teuthology.orchestra.run.smithi197.stdout: "display_name": "Mr. ragweed.client.0", 2020-04-28T12:40:42.272 INFO:teuthology.orchestra.run.smithi197.stdout: "email": "ragweed.client.0+test@test.test", 2020-04-28T12:40:42.272 INFO:teuthology.orchestra.run.smithi197.stdout: "suspended": 0, 2020-04-28T12:40:42.272 INFO:teuthology.orchestra.run.smithi197.stdout: "max_buckets": 1000, 2020-04-28T12:40:42.273 INFO:teuthology.orchestra.run.smithi197.stdout: "subusers": [], 2020-04-28T12:40:42.273 INFO:teuthology.orchestra.run.smithi197.stdout: "keys": [ 2020-04-28T12:40:42.273 INFO:teuthology.orchestra.run.smithi197.stdout: { 2020-04-28T12:40:42.273 INFO:teuthology.orchestra.run.smithi197.stdout: "user": "ragweed.client.0", 2020-04-28T12:40:42.273 INFO:teuthology.orchestra.run.smithi197.stdout: "access_key": "CSWNFZXWAAGDRFVJFXNK", 2020-04-28T12:40:42.273 INFO:teuthology.orchestra.run.smithi197.stdout: "secret_key": "SmKBVzeHbmC7/xLbP9nwuv4Oap5bYzOQBXTgvIQrz1AXrk/frRwI3Q==" 2020-04-28T12:40:42.273 INFO:teuthology.orchestra.run.smithi197.stdout: } 2020-04-28T12:40:42.274 INFO:teuthology.orchestra.run.smithi197.stdout: ], 2020-04-28T12:40:42.274 INFO:teuthology.orchestra.run.smithi197.stdout: "swift_keys": [], 2020-04-28T12:40:42.274 INFO:teuthology.orchestra.run.smithi197.stdout: "caps": [], 2020-04-28T12:40:42.274 INFO:teuthology.orchestra.run.smithi197.stdout: "op_mask": "read, write, delete", 2020-04-28T12:40:42.274 INFO:teuthology.orchestra.run.smithi197.stdout: "default_placement": "", 2020-04-28T12:40:42.274 INFO:teuthology.orchestra.run.smithi197.stdout: "default_storage_class": "", 2020-04-28T12:40:42.274 INFO:teuthology.orchestra.run.smithi197.stdout: "placement_tags": [], 2020-04-28T12:40:42.275 INFO:teuthology.orchestra.run.smithi197.stdout: "bucket_quota": { 2020-04-28T12:40:42.275 INFO:teuthology.orchestra.run.smithi197.stdout: "enabled": false, 2020-04-28T12:40:42.275 INFO:teuthology.orchestra.run.smithi197.stdout: "check_on_raw": false, 2020-04-28T12:40:42.275 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size": -1, 2020-04-28T12:40:42.275 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size_kb": 0, 2020-04-28T12:40:42.275 INFO:teuthology.orchestra.run.smithi197.stdout: "max_objects": -1 2020-04-28T12:40:42.276 INFO:teuthology.orchestra.run.smithi197.stdout: }, 2020-04-28T12:40:42.276 INFO:teuthology.orchestra.run.smithi197.stdout: "user_quota": { 2020-04-28T12:40:42.276 INFO:teuthology.orchestra.run.smithi197.stdout: "enabled": false, 2020-04-28T12:40:42.276 INFO:teuthology.orchestra.run.smithi197.stdout: "check_on_raw": false, 2020-04-28T12:40:42.276 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size": -1, 2020-04-28T12:40:42.276 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size_kb": 0, 2020-04-28T12:40:42.276 INFO:teuthology.orchestra.run.smithi197.stdout: "max_objects": -1 2020-04-28T12:40:42.277 INFO:teuthology.orchestra.run.smithi197.stdout: }, 2020-04-28T12:40:42.277 INFO:teuthology.orchestra.run.smithi197.stdout: "temp_url_keys": [], 2020-04-28T12:40:42.277 INFO:teuthology.orchestra.run.smithi197.stdout: "type": "rgw", 2020-04-28T12:40:42.277 INFO:teuthology.orchestra.run.smithi197.stdout: "mfa_ids": [] 2020-04-28T12:40:42.277 INFO:teuthology.orchestra.run.smithi197.stdout:} 2020-04-28T12:40:42.277 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:40:42.278 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.269+0000 7f5594c19180 20 remove_watcher() i=0 2020-04-28T12:40:42.278 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.269+0000 7f5594c19180 2 removed watcher, disabling cache 2020-04-28T12:40:42.278 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.270+0000 7f5594c19180 20 remove_watcher() i=1 2020-04-28T12:40:42.279 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.271+0000 7f5594c19180 20 remove_watcher() i=2 2020-04-28T12:40:42.279 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.272+0000 7f5594c19180 20 remove_watcher() i=3 2020-04-28T12:40:42.279 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.273+0000 7f5594c19180 20 remove_watcher() i=4 2020-04-28T12:40:42.279 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.275+0000 7f5594c19180 20 remove_watcher() i=5 2020-04-28T12:40:42.279 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.276+0000 7f5594c19180 20 remove_watcher() i=6 2020-04-28T12:40:42.280 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:40:42.277+0000 7f5594c19180 20 remove_watcher() i=7 2020-04-28T12:40:42.284 INFO:tasks.ragweed:Configuring ragweed... 2020-04-28T12:40:42.284 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:40:42.298 INFO:teuthology.orchestra.run.smithi197:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2020-04-28T12:40:45.145 INFO:teuthology.orchestra.run.smithi197.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2020-04-28T12:40:45.532 INFO:teuthology.orchestra.run.smithi197.stdout:Last metadata expiration check: 0:07:34 ago on Tue 28 Apr 2020 12:33:11 PM UTC. 2020-04-28T12:40:45.818 INFO:teuthology.orchestra.run.smithi197.stdout:Package python36-devel-3.6.8-2.module_el8.1.0+245+c39af44f.x86_64 is already installed. 2020-04-28T12:40:45.925 INFO:teuthology.orchestra.run.smithi197.stdout:Dependencies resolved. 2020-04-28T12:40:45.926 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:40:45.927 INFO:teuthology.orchestra.run.smithi197.stdout: Package Arch Version Repository Size 2020-04-28T12:40:45.927 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:40:45.927 INFO:teuthology.orchestra.run.smithi197.stdout:Installing: 2020-04-28T12:40:45.927 INFO:teuthology.orchestra.run.smithi197.stdout: libevent-devel x86_64 2.1.8-5.el8 CentOS-AppStream 104 k 2020-04-28T12:40:45.927 INFO:teuthology.orchestra.run.smithi197.stdout: libxml2-devel x86_64 2.9.7-5.el8 CentOS-AppStream 1.0 M 2020-04-28T12:40:45.927 INFO:teuthology.orchestra.run.smithi197.stdout: libxslt-devel x86_64 1.1.32-3.el8 CentOS-AppStream 322 k 2020-04-28T12:40:45.928 INFO:teuthology.orchestra.run.smithi197.stdout: zlib-devel x86_64 1.2.11-10.el8 CentOS-Base 56 k 2020-04-28T12:40:45.928 INFO:teuthology.orchestra.run.smithi197.stdout:Installing dependencies: 2020-04-28T12:40:45.928 INFO:teuthology.orchestra.run.smithi197.stdout: cmake-filesystem x86_64 3.11.4-3.el8 CentOS-AppStream 40 k 2020-04-28T12:40:45.928 INFO:teuthology.orchestra.run.smithi197.stdout: libgcrypt-devel x86_64 1.8.3-4.el8 CentOS-Base 149 k 2020-04-28T12:40:45.929 INFO:teuthology.orchestra.run.smithi197.stdout: libgpg-error-devel x86_64 1.31-1.el8 CentOS-Base 64 k 2020-04-28T12:40:45.929 INFO:teuthology.orchestra.run.smithi197.stdout: xz-devel x86_64 5.2.4-3.el8 CentOS-Base 62 k 2020-04-28T12:40:45.929 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:40:45.929 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction Summary 2020-04-28T12:40:45.930 INFO:teuthology.orchestra.run.smithi197.stdout:================================================================================ 2020-04-28T12:40:45.930 INFO:teuthology.orchestra.run.smithi197.stdout:Install 8 Packages 2020-04-28T12:40:45.930 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:40:45.931 INFO:teuthology.orchestra.run.smithi197.stdout:Total download size: 1.8 M 2020-04-28T12:40:45.931 INFO:teuthology.orchestra.run.smithi197.stdout:Installed size: 12 M 2020-04-28T12:40:45.931 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading Packages: 2020-04-28T12:40:45.959 INFO:teuthology.orchestra.run.smithi197.stdout:(1/8): cmake-filesystem-3.11.4-3.el8.x86_64.rpm 1.3 MB/s | 40 kB 00:00 2020-04-28T12:40:45.964 INFO:teuthology.orchestra.run.smithi197.stdout:(2/8): libxslt-devel-1.1.32-3.el8.x86_64.rpm 60 MB/s | 322 kB 00:00 2020-04-28T12:40:45.965 INFO:teuthology.orchestra.run.smithi197.stdout:(3/8): libevent-devel-2.1.8-5.el8.x86_64.rpm 2.8 MB/s | 104 kB 00:00 2020-04-28T12:40:45.967 INFO:teuthology.orchestra.run.smithi197.stdout:(4/8): libgcrypt-devel-1.8.3-4.el8.x86_64.rpm 52 MB/s | 149 kB 00:00 2020-04-28T12:40:45.968 INFO:teuthology.orchestra.run.smithi197.stdout:(5/8): libgpg-error-devel-1.31-1.el8.x86_64.rpm 23 MB/s | 64 kB 00:00 2020-04-28T12:40:45.971 INFO:teuthology.orchestra.run.smithi197.stdout:(6/8): zlib-devel-1.2.11-10.el8.x86_64.rpm 20 MB/s | 56 kB 00:00 2020-04-28T12:40:45.971 INFO:teuthology.orchestra.run.smithi197.stdout:(7/8): xz-devel-5.2.4-3.el8.x86_64.rpm 16 MB/s | 62 kB 00:00 2020-04-28T12:40:45.980 INFO:teuthology.orchestra.run.smithi197.stdout:(8/8): libxml2-devel-2.9.7-5.el8.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2020-04-28T12:40:45.982 INFO:teuthology.orchestra.run.smithi197.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:40:45.982 INFO:teuthology.orchestra.run.smithi197.stdout:Total 33 MB/s | 1.8 MB 00:00 2020-04-28T12:40:45.991 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction check 2020-04-28T12:40:46.002 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction check succeeded. 2020-04-28T12:40:46.002 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction test 2020-04-28T12:40:46.111 INFO:teuthology.orchestra.run.smithi197.stdout:Transaction test succeeded. 2020-04-28T12:40:46.112 INFO:teuthology.orchestra.run.smithi197.stdout:Running transaction 2020-04-28T12:40:46.457 INFO:teuthology.orchestra.run.smithi197.stdout: Preparing : 1/1 2020-04-28T12:40:46.620 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:40:46.643 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:40:46.886 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:40:46.899 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:40:47.083 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 3/8 2020-04-28T12:40:47.301 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : xz-devel-5.2.4-3.el8.x86_64 4/8 2020-04-28T12:40:47.729 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : cmake-filesystem-3.11.4-3.el8.x86_64 5/8 2020-04-28T12:40:48.069 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libxml2-devel-2.9.7-5.el8.x86_64 6/8 2020-04-28T12:40:48.366 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libxslt-devel-1.1.32-3.el8.x86_64 7/8 2020-04-28T12:40:48.543 INFO:teuthology.orchestra.run.smithi197.stdout: Installing : libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:40:48.764 INFO:teuthology.orchestra.run.smithi197.stdout: Running scriptlet: libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:40:48.765 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : cmake-filesystem-3.11.4-3.el8.x86_64 1/8 2020-04-28T12:40:48.765 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libevent-devel-2.1.8-5.el8.x86_64 2/8 2020-04-28T12:40:48.765 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libxml2-devel-2.9.7-5.el8.x86_64 3/8 2020-04-28T12:40:48.765 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libxslt-devel-1.1.32-3.el8.x86_64 4/8 2020-04-28T12:40:48.765 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libgcrypt-devel-1.8.3-4.el8.x86_64 5/8 2020-04-28T12:40:48.765 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : libgpg-error-devel-1.31-1.el8.x86_64 6/8 2020-04-28T12:40:48.766 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : xz-devel-5.2.4-3.el8.x86_64 7/8 2020-04-28T12:40:49.085 INFO:teuthology.orchestra.run.smithi197.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 8/8 2020-04-28T12:40:49.085 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:40:49.085 INFO:teuthology.orchestra.run.smithi197.stdout:Installed: 2020-04-28T12:40:49.085 INFO:teuthology.orchestra.run.smithi197.stdout: libevent-devel-2.1.8-5.el8.x86_64 libxml2-devel-2.9.7-5.el8.x86_64 2020-04-28T12:40:49.085 INFO:teuthology.orchestra.run.smithi197.stdout: libxslt-devel-1.1.32-3.el8.x86_64 zlib-devel-1.2.11-10.el8.x86_64 2020-04-28T12:40:49.085 INFO:teuthology.orchestra.run.smithi197.stdout: cmake-filesystem-3.11.4-3.el8.x86_64 libgcrypt-devel-1.8.3-4.el8.x86_64 2020-04-28T12:40:49.086 INFO:teuthology.orchestra.run.smithi197.stdout: libgpg-error-devel-1.31-1.el8.x86_64 xz-devel-5.2.4-3.el8.x86_64 2020-04-28T12:40:49.086 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:40:49.086 INFO:teuthology.orchestra.run.smithi197.stdout:Complete! 2020-04-28T12:40:50.175 INFO:teuthology.orchestra.run.smithi197.stdout:Using base prefix '/usr' 2020-04-28T12:40:50.175 INFO:teuthology.orchestra.run.smithi197.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python3 2020-04-28T12:40:50.176 INFO:teuthology.orchestra.run.smithi197.stdout:Also creating executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2020-04-28T12:40:52.818 INFO:teuthology.orchestra.run.smithi197.stdout:Installing setuptools, pip, wheel...done. 2020-04-28T12:40:52.827 INFO:teuthology.orchestra.run.smithi197.stdout:Running virtualenv with interpreter /usr/bin/python3 2020-04-28T12:40:53.362 INFO:teuthology.orchestra.run.smithi197.stdout:Requirement already up-to-date: pip in ./virtualenv/lib/python3.6/site-packages (20.0.2) 2020-04-28T12:40:54.107 INFO:teuthology.orchestra.run.smithi197.stdout:Requirement already satisfied: six in /usr/lib/python3.6/site-packages (1.11.0) 2020-04-28T12:40:54.755 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting nose 2020-04-28T12:40:54.799 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading nose-1.3.7-py3-none-any.whl (154 kB) 2020-04-28T12:40:54.961 INFO:teuthology.orchestra.run.smithi197.stdout:Installing collected packages: nose 2020-04-28T12:40:55.043 INFO:teuthology.orchestra.run.smithi197.stdout:Successfully installed nose-1.3.7 2020-04-28T12:40:55.481 INFO:teuthology.orchestra.run.smithi197.stdout:Requirement already satisfied: setuptools in ./virtualenv/lib/python3.6/site-packages (46.1.3) 2020-04-28T12:40:56.239 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting PyYAML 2020-04-28T12:40:56.282 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading PyYAML-5.3.1.tar.gz (269 kB) 2020-04-28T12:40:57.393 INFO:teuthology.orchestra.run.smithi197.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python3.6/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2020-04-28T12:40:57.500 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting boto!=2.46.0,>=2.6.0 2020-04-28T12:40:57.517 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading boto-2.49.0-py2.py3-none-any.whl (1.4 MB) 2020-04-28T12:40:57.770 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting munch>=1.0.0 2020-04-28T12:40:57.779 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading munch-2.5.0-py2.py3-none-any.whl (10 kB) 2020-04-28T12:40:58.064 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting gevent>=1.0 2020-04-28T12:40:58.082 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading gevent-20.4.0-cp36-cp36m-manylinux2010_x86_64.whl (5.1 MB) 2020-04-28T12:40:58.471 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting httplib2 2020-04-28T12:40:58.480 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading httplib2-0.17.3-py3-none-any.whl (95 kB) 2020-04-28T12:40:59.107 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting lxml 2020-04-28T12:40:59.116 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading lxml-4.5.0-cp36-cp36m-manylinux1_x86_64.whl (5.8 MB) 2020-04-28T12:40:59.333 INFO:teuthology.orchestra.run.smithi197.stdout:Requirement already satisfied, skipping upgrade: six in /usr/lib/python3.6/site-packages (from munch>=1.0.0->-r requirements.txt (line 4)) (1.11.0) 2020-04-28T12:40:59.459 INFO:teuthology.orchestra.run.smithi197.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2020-04-28T12:40:59.462 INFO:teuthology.orchestra.run.smithi197.stdout: Downloading greenlet-0.4.15-cp36-cp36m-manylinux1_x86_64.whl (41 kB) 2020-04-28T12:40:59.513 INFO:teuthology.orchestra.run.smithi197.stdout:Building wheels for collected packages: PyYAML 2020-04-28T12:40:59.513 INFO:teuthology.orchestra.run.smithi197.stdout: Building wheel for PyYAML (setup.py): started 2020-04-28T12:40:59.980 INFO:teuthology.orchestra.run.smithi197.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2020-04-28T12:40:59.980 INFO:teuthology.orchestra.run.smithi197.stdout: Created wheel for PyYAML: filename=PyYAML-5.3.1-cp36-cp36m-linux_x86_64.whl size=44621 sha256=35005a689003902d3fc866e0e225dcd1ef51e87f62ee78731992f06915f6b3be 2020-04-28T12:40:59.981 INFO:teuthology.orchestra.run.smithi197.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/e5/9d/ad/2ee53cf262cba1ffd8afe1487eef788ea3f260b7e6232a80fc 2020-04-28T12:40:59.981 INFO:teuthology.orchestra.run.smithi197.stdout:Successfully built PyYAML 2020-04-28T12:41:00.165 INFO:teuthology.orchestra.run.smithi197.stdout:Installing collected packages: PyYAML, boto, munch, greenlet, gevent, httplib2, lxml 2020-04-28T12:41:00.165 INFO:teuthology.orchestra.run.smithi197.stdout: Attempting uninstall: PyYAML 2020-04-28T12:41:00.166 INFO:teuthology.orchestra.run.smithi197.stdout: Found existing installation: PyYAML 3.12 2020-04-28T12:41:00.166 INFO:teuthology.orchestra.run.smithi197.stdout: Not uninstalling pyyaml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:41:00.166 INFO:teuthology.orchestra.run.smithi197.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2020-04-28T12:41:01.242 INFO:teuthology.orchestra.run.smithi197.stdout: Attempting uninstall: lxml 2020-04-28T12:41:01.243 INFO:teuthology.orchestra.run.smithi197.stdout: Found existing installation: lxml 4.2.3 2020-04-28T12:41:01.243 INFO:teuthology.orchestra.run.smithi197.stdout: Not uninstalling lxml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:41:01.243 INFO:teuthology.orchestra.run.smithi197.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2020-04-28T12:41:01.408 INFO:teuthology.orchestra.run.smithi197.stdout:Successfully installed PyYAML-5.3.1 boto-2.49.0 gevent-20.4.0 greenlet-0.4.15 httplib2-0.17.3 lxml-4.5.0 munch-2.5.0 2020-04-28T12:41:01.742 INFO:teuthology.orchestra.run.smithi197.stdout:running develop 2020-04-28T12:41:01.775 INFO:teuthology.orchestra.run.smithi197.stdout:running egg_info 2020-04-28T12:41:01.775 INFO:teuthology.orchestra.run.smithi197.stdout:creating ragweed.egg-info 2020-04-28T12:41:01.775 INFO:teuthology.orchestra.run.smithi197.stdout:writing ragweed.egg-info/PKG-INFO 2020-04-28T12:41:01.775 INFO:teuthology.orchestra.run.smithi197.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2020-04-28T12:41:01.775 INFO:teuthology.orchestra.run.smithi197.stdout:writing requirements to ragweed.egg-info/requires.txt 2020-04-28T12:41:01.775 INFO:teuthology.orchestra.run.smithi197.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2020-04-28T12:41:01.776 INFO:teuthology.orchestra.run.smithi197.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:41:01.786 INFO:teuthology.orchestra.run.smithi197.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:41:01.787 INFO:teuthology.orchestra.run.smithi197.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:41:01.788 INFO:teuthology.orchestra.run.smithi197.stdout:running build_ext 2020-04-28T12:41:01.789 INFO:teuthology.orchestra.run.smithi197.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/ragweed.egg-link (link to .) 2020-04-28T12:41:01.789 INFO:teuthology.orchestra.run.smithi197.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2020-04-28T12:41:01.789 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.789 INFO:teuthology.orchestra.run.smithi197.stdout:Installed /home/ubuntu/cephtest/ragweed 2020-04-28T12:41:01.790 INFO:teuthology.orchestra.run.smithi197.stdout:Processing dependencies for ragweed==0.0.1 2020-04-28T12:41:01.795 INFO:teuthology.orchestra.run.smithi197.stdout:Searching for isodate>=0.4.4 2020-04-28T12:41:01.795 INFO:teuthology.orchestra.run.smithi197.stdout:Reading https://pypi.org/simple/isodate/ 2020-04-28T12:41:01.842 INFO:teuthology.orchestra.run.smithi197.stdout:Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl#sha256=aa4d33c06640f5352aca96e4b81afd8ab3b47337cc12089822d6f322ac772c81 2020-04-28T12:41:01.904 INFO:teuthology.orchestra.run.smithi197.stdout:Best match: isodate 0.6.0 2020-04-28T12:41:01.904 INFO:teuthology.orchestra.run.smithi197.stdout:Processing isodate-0.6.0-py2.py3-none-any.whl 2020-04-28T12:41:01.905 INFO:teuthology.orchestra.run.smithi197.stdout:Installing isodate-0.6.0-py2.py3-none-any.whl to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:41:01.914 INFO:teuthology.orchestra.run.smithi197.stdout:Adding isodate 0.6.0 to easy-install.pth file 2020-04-28T12:41:01.914 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.915 INFO:teuthology.orchestra.run.smithi197.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/isodate-0.6.0-py3.6.egg 2020-04-28T12:41:01.963 INFO:teuthology.orchestra.run.smithi197.stdout:Searching for gevent==20.4.0 2020-04-28T12:41:01.964 INFO:teuthology.orchestra.run.smithi197.stdout:Best match: gevent 20.4.0 2020-04-28T12:41:01.964 INFO:teuthology.orchestra.run.smithi197.stdout:Adding gevent 20.4.0 to easy-install.pth file 2020-04-28T12:41:01.964 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.964 INFO:teuthology.orchestra.run.smithi197.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:41:01.965 INFO:teuthology.orchestra.run.smithi197.stdout:Searching for munch==2.5.0 2020-04-28T12:41:01.965 INFO:teuthology.orchestra.run.smithi197.stdout:Best match: munch 2.5.0 2020-04-28T12:41:01.965 INFO:teuthology.orchestra.run.smithi197.stdout:Adding munch 2.5.0 to easy-install.pth file 2020-04-28T12:41:01.966 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.966 INFO:teuthology.orchestra.run.smithi197.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:41:01.966 INFO:teuthology.orchestra.run.smithi197.stdout:Searching for PyYAML==5.3.1 2020-04-28T12:41:01.966 INFO:teuthology.orchestra.run.smithi197.stdout:Best match: PyYAML 5.3.1 2020-04-28T12:41:01.966 INFO:teuthology.orchestra.run.smithi197.stdout:Adding PyYAML 5.3.1 to easy-install.pth file 2020-04-28T12:41:01.967 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.967 INFO:teuthology.orchestra.run.smithi197.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:41:01.967 INFO:teuthology.orchestra.run.smithi197.stdout:Searching for boto==2.49.0 2020-04-28T12:41:01.968 INFO:teuthology.orchestra.run.smithi197.stdout:Best match: boto 2.49.0 2020-04-28T12:41:01.968 INFO:teuthology.orchestra.run.smithi197.stdout:Adding boto 2.49.0 to easy-install.pth file 2020-04-28T12:41:01.968 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.968 INFO:teuthology.orchestra.run.smithi197.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:41:01.968 INFO:teuthology.orchestra.run.smithi197.stdout:Searching for six==1.11.0 2020-04-28T12:41:01.968 INFO:teuthology.orchestra.run.smithi197.stdout:Best match: six 1.11.0 2020-04-28T12:41:01.969 INFO:teuthology.orchestra.run.smithi197.stdout:Adding six 1.11.0 to easy-install.pth file 2020-04-28T12:41:01.969 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.969 INFO:teuthology.orchestra.run.smithi197.stdout:Using /usr/lib/python3.6/site-packages 2020-04-28T12:41:01.970 INFO:teuthology.orchestra.run.smithi197.stdout:Searching for greenlet==0.4.15 2020-04-28T12:41:01.970 INFO:teuthology.orchestra.run.smithi197.stdout:Best match: greenlet 0.4.15 2020-04-28T12:41:01.970 INFO:teuthology.orchestra.run.smithi197.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2020-04-28T12:41:01.970 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:41:01.970 INFO:teuthology.orchestra.run.smithi197.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:41:01.970 INFO:teuthology.orchestra.run.smithi197.stdout:Finished processing dependencies for ragweed==0.0.1 2020-04-28T12:41:01.988 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:02.001 INFO:teuthology.orchestra.run.smithi197:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2020-04-28T12:41:02.092 INFO:tasks.ragweed:Configuring boto... 2020-04-28T12:41:02.093 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:02.146 INFO:teuthology.orchestra.run.smithi197:> cat > /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:41:02.230 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:02.284 INFO:teuthology.orchestra.run.smithi197:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2020-04-28T12:41:06.640 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2020-04-28T12:41:08.351 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2020-04-28T12:41:09.971 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2020-04-28T12:41:11.522 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2020-04-28T12:41:16.630 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2020-04-28T12:41:20.383 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2020-04-28T12:41:23.346 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2020-04-28T12:41:28.102 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2020-04-28T12:41:32.602 INFO:teuthology.orchestra.run.smithi197.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2020-04-28T12:41:32.602 INFO:teuthology.orchestra.run.smithi197.stderr: 2020-04-28T12:41:32.602 INFO:teuthology.orchestra.run.smithi197.stderr:---------------------------------------------------------------------- 2020-04-28T12:41:32.603 INFO:teuthology.orchestra.run.smithi197.stderr:Ran 9 tests in 30.036s 2020-04-28T12:41:32.603 INFO:teuthology.orchestra.run.smithi197.stderr: 2020-04-28T12:41:32.603 INFO:teuthology.orchestra.run.smithi197.stderr:OK 2020-04-28T12:41:32.631 INFO:tasks.ragweed:Cleaning up boto... 2020-04-28T12:41:32.631 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:32.644 INFO:teuthology.orchestra.run.smithi197:> rm /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:41:32.698 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:32.751 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2020-04-28T12:41:32.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.827+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.829+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.829+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.830+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.830+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.841 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.830+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.841 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.830+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.841 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.831+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:32.851 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.846+0000 7f8c5f44d180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:41:32.851 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.846+0000 7f8c5f44d180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:41:32.851 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.846+0000 7f8c5f44d180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:41:32.852 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.846+0000 7f8c5f44d180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:41:32.852 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.846+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.852 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.847+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:32.852 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.847+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.853 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.847+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:41:32.853 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.847+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.848+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:32.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.848+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.848+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:41:32.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.848+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.848+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.848+0000 7f8c5f44d180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:41:32.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.848+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.855 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.849+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.855 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.849+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.856 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.849+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:32.856 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.849+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.856 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 20 zonegroup default 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 10 Cannot find current period zone using local zone 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.850+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.851+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:32.858 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.851+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.858 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.851+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:41:32.858 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.851+0000 7f8c5f44d180 20 zone default found 2020-04-28T12:41:32.858 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.851+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.866 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.852+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.866 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.852+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:32.867 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.852+0000 7f8c5f44d180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:32.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.852+0000 7f8c5f44d180 20 started sync module instance, tier type = 2020-04-28T12:41:32.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.852+0000 7f8c5f44d180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:41:32.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.853+0000 7f8c4dc42700 0 -- 172.21.15.197:0/316367087 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f8c4403ded0 msgr2=0x7f8c44008170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:32.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.863+0000 7f8c5f44d180 20 add_watcher() i=0 2020-04-28T12:41:32.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.863+0000 7f8c5f44d180 20 add_watcher() i=1 2020-04-28T12:41:32.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.863+0000 7f8c5f44d180 20 add_watcher() i=2 2020-04-28T12:41:32.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.863+0000 7f8c5f44d180 20 add_watcher() i=3 2020-04-28T12:41:32.869 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.863+0000 7f8c5f44d180 20 add_watcher() i=4 2020-04-28T12:41:32.869 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.863+0000 7f8c5f44d180 20 add_watcher() i=5 2020-04-28T12:41:32.869 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.863+0000 7f8c5f44d180 20 add_watcher() i=6 2020-04-28T12:41:32.870 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.864+0000 7f8c5f44d180 20 add_watcher() i=7 2020-04-28T12:41:32.870 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.864+0000 7f8c5f44d180 2 all 8 watchers are set, enabling cache 2020-04-28T12:41:32.870 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.864+0000 7f8c5f44d180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:32.870 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.864+0000 7f8c5f44d180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:32.870 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.864+0000 7f8c1dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:32.870 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:32.865+0000 7f8c4dc42700 0 -- 172.21.15.197:0/318871027 >> v2:172.21.15.197:3300/0 conn(0x563a3b29c3a0 msgr2=0x563a3b29c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:41:33.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.066+0000 7f8c4dc42700 0 --2- 172.21.15.197:0/318871027 >> v2:172.21.15.197:3300/0 conn(0x563a3b29c3a0 0x563a3b29c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2020-04-28T12:41:33.122 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.117+0000 7f8b8ffff700 20 reqs_thread_entry: start 2020-04-28T12:41:33.123 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.117+0000 7f8b8dffb700 20 reqs_thread_entry: start 2020-04-28T12:41:33.123 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 20 init_complete bucket index max shards: 1999 2020-04-28T12:41:33.123 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8b7bfff700 20 reqs_thread_entry: start 2020-04-28T12:41:33.123 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 20 get_system_obj_state: rctx=0x7ffc31c16928 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x563a3b148040 s->prefetch_data=0 2020-04-28T12:41:33.123 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:41:33.124 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2020-04-28T12:41:33.124 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:41:33.124 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:33.125 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:33.125 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.118+0000 7f8c5f44d180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:41:33.125 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.119+0000 7f8c5f44d180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.125 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.119+0000 7f8c5f44d180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:41:33.125 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.119+0000 7f8c5f44d180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2020-04-28T12:41:33.125 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.119+0000 7f8c5f44d180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:41:33.125 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.119+0000 7f8c5f44d180 10 removing key index: FMKOFNYXKFWENWPJDOXN 2020-04-28T12:41:33.126 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.119+0000 7f8c5f44d180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=170 2020-04-28T12:41:33.126 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.120+0000 7f8c2e7fc700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94808100639408 notifier 4538 bl.length()=170 2020-04-28T12:41:33.127 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.122+0000 7f8c5f44d180 10 removing email index: sysuser.client.0+test@test.test 2020-04-28T12:41:33.127 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.122+0000 7f8c5f44d180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2020-04-28T12:41:33.127 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.122+0000 7f8c2e7fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94808100631408 notifier 4538 bl.length()=182 2020-04-28T12:41:33.128 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.124+0000 7f8c5f44d180 10 removing user buckets index 2020-04-28T12:41:33.129 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.124+0000 7f8c5f44d180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2020-04-28T12:41:33.129 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.124+0000 7f8c2e7fc700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94808100627616 notifier 4538 bl.length()=173 2020-04-28T12:41:33.131 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.126+0000 7f8c5f44d180 10 removing user index: sysuser.client.0 2020-04-28T12:41:33.131 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.126+0000 7f8c5f44d180 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2020-04-28T12:41:33.131 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.126+0000 7f8c5f44d180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2020-04-28T12:41:33.132 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.127+0000 7f8c2e7fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94808100623648 notifier 4538 bl.length()=165 2020-04-28T12:41:33.133 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.129+0000 7f8c1dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:33.135 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.130+0000 7f8c5f44d180 20 remove_watcher() i=0 2020-04-28T12:41:33.135 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.130+0000 7f8c5f44d180 2 removed watcher, disabling cache 2020-04-28T12:41:33.136 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.132+0000 7f8c5f44d180 20 remove_watcher() i=1 2020-04-28T12:41:33.137 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.133+0000 7f8c5f44d180 20 remove_watcher() i=2 2020-04-28T12:41:33.139 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.134+0000 7f8c5f44d180 20 remove_watcher() i=3 2020-04-28T12:41:33.140 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.135+0000 7f8c5f44d180 20 remove_watcher() i=4 2020-04-28T12:41:33.141 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.136+0000 7f8c5f44d180 20 remove_watcher() i=5 2020-04-28T12:41:33.142 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.137+0000 7f8c5f44d180 20 remove_watcher() i=6 2020-04-28T12:41:33.143 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.138+0000 7f8c5f44d180 20 remove_watcher() i=7 2020-04-28T12:41:33.147 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:33.201 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2020-04-28T12:41:33.282 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.277+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.290 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.279+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.290 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.279+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.290 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.279+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.291 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.279+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.291 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.280+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.291 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.280+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.291 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.281+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:33.301 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.296+0000 7f2143156180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:41:33.301 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.296+0000 7f2143156180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:41:33.301 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.296+0000 7f2143156180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:41:33.301 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.296+0000 7f2143156180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:41:33.301 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.296+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.302 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.297+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:33.302 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.297+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.302 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.297+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:41:33.303 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.297+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.303 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.297+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:33.303 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.298+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.304 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.298+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:41:33.304 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.298+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.304 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.298+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.304 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.298+0000 7f2143156180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:41:33.304 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.298+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.299+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.299+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.299+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:33.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.299+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.307 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:41:33.308 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 20 zonegroup default 2020-04-28T12:41:33.308 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.308 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.308 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 10 Cannot find current period zone using local zone 2020-04-28T12:41:33.308 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.308 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.309 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.300+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.309 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.301+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:41:33.309 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.301+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.309 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.301+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:41:33.309 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.301+0000 7f2143156180 20 zone default found 2020-04-28T12:41:33.309 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.301+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.309 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.302+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.310 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.302+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.310 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.302+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:33.310 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.302+0000 7f2143156180 20 started sync module instance, tier type = 2020-04-28T12:41:33.310 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.302+0000 7f2143156180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:41:33.311 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.303+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f2128005b60 msgr2=0x7f21280086e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:33.317 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.313+0000 7f2143156180 20 add_watcher() i=0 2020-04-28T12:41:33.318 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.313+0000 7f2143156180 20 add_watcher() i=1 2020-04-28T12:41:33.318 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.313+0000 7f2143156180 20 add_watcher() i=2 2020-04-28T12:41:33.318 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.313+0000 7f2143156180 20 add_watcher() i=3 2020-04-28T12:41:33.318 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.313+0000 7f2143156180 20 add_watcher() i=4 2020-04-28T12:41:33.318 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.313+0000 7f2143156180 20 add_watcher() i=5 2020-04-28T12:41:33.319 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.313+0000 7f2143156180 20 add_watcher() i=6 2020-04-28T12:41:33.319 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.314+0000 7f2143156180 20 add_watcher() i=7 2020-04-28T12:41:33.319 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.314+0000 7f2143156180 2 all 8 watchers are set, enabling cache 2020-04-28T12:41:33.320 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.314+0000 7f2143156180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:41:33.320 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.314+0000 7f2143156180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:41:33.320 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.314+0000 7f2101fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:33.320 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.314+0000 7f213194b700 0 -- >> [v2:172.21.15.197:3301/0,v1:172.21.15.197:6790/0] conn(0x55bc5db032a0 msgr2=0x55bc5db036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2020-04-28T12:41:33.369 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.364+0000 7f2073fff700 20 reqs_thread_entry: start 2020-04-28T12:41:33.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.364+0000 7f2071ffb700 20 reqs_thread_entry: start 2020-04-28T12:41:33.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.364+0000 7f2143156180 20 init_complete bucket index max shards: 1999 2020-04-28T12:41:33.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.364+0000 7f205ffff700 20 reqs_thread_entry: start 2020-04-28T12:41:33.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.364+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc761883e8 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:33.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.364+0000 7f2143156180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:41:33.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.365+0000 7f2143156180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2020-04-28T12:41:33.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.365+0000 7f2143156180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:41:33.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.365+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:33.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.365+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:33.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.365+0000 7f2143156180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:41:33.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.365+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.366+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:41:33.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.366+0000 7f2143156180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2020-04-28T12:41:33.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.366+0000 7f2143156180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:41:33.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.366+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-conf state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:33.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.366+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2020-04-28T12:41:33.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2020-04-28T12:41:33.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:41:33.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:33.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:33.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:33.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=200 2020-04-28T12:41:33.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2020-04-28T12:41:33.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:41:33.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:33.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.367+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 : miss 2020-04-28T12:41:33.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 info.flags=0x16 2020-04-28T12:41:33.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 to cache LRU end 2020-04-28T12:41:33.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:33.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:33.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:33.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:33.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:33.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:33.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.368+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:33.377 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.369+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=293 2020-04-28T12:41:33.377 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.369+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 info.flags=0x13 2020-04-28T12:41:33.377 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.369+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 to cache LRU end 2020-04-28T12:41:33.377 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.369+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:33.377 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.369+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:33.377 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.369+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 2020-04-28T12:41:33.504 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.499+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-conf[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1]) start_after [] num_entries 1100 2020-04-28T12:41:33.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.585+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2020-04-28T12:41:33.617 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.612+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2020-04-28T12:41:33.740 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.735+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:33.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.745+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f211405f880 msgr2=0x7f21140675d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:33.754 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.750+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211406ba80 msgr2=0x7f21140665b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:33.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:33.874+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x55bc5dae9a20 msgr2=0x7f2114063d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:34.091 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.087+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2020-04-28T12:41:34.101 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.097+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2020-04-28T12:41:34.158 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.153+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2020-04-28T12:41:34.254 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.248+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2020-04-28T12:41:34.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.266+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2020-04-28T12:41:34.390 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.385+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2020-04-28T12:41:34.444 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.440+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2020-04-28T12:41:34.522 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.517+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.523 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.518+0000 7f2143156180 10 manifest: total_size = 12692 2020-04-28T12:41:34.523 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.518+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.56 2020-04-28T12:41:34.523 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.518+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.523 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.518+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.523 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.518+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.162 2020-04-28T12:41:34.526 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.521+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : miss 2020-04-28T12:41:34.526 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.521+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.527 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.527 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.527 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : miss 2020-04-28T12:41:34.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.529 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.529 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.529 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.522+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.529 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.523+0000 7f2143156180 10 manifest: total_size = 7569 2020-04-28T12:41:34.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.523+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.30 2020-04-28T12:41:34.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.523+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.523+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.523+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.215 2020-04-28T12:41:34.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.526+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.526+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.527+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.528+0000 7f2143156180 10 manifest: total_size = 4868 2020-04-28T12:41:34.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.528+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.13 2020-04-28T12:41:34.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.528+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.528+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.528+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.1143 2020-04-28T12:41:34.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.531+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.531+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.531+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.531+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.531+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.531+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.531+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.532+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.532+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.532+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.532+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.532+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.532+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.532+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.533+0000 7f2143156180 10 manifest: total_size = 7638 2020-04-28T12:41:34.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.533+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.247 2020-04-28T12:41:34.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.533+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.533+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.533+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.1162 2020-04-28T12:41:34.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.537+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.538+0000 7f2143156180 10 manifest: total_size = 7640 2020-04-28T12:41:34.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.538+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.120 2020-04-28T12:41:34.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.538+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.538+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.538+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.1273 2020-04-28T12:41:34.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.541+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.541+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.541+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.541+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.541+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.541+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.541+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.542+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.542+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.542+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.542+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.542+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.542+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.542+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.543+0000 7f2143156180 10 manifest: total_size = 14076 2020-04-28T12:41:34.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.543+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.190 2020-04-28T12:41:34.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.543+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.543+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.550 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.543+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.1462 2020-04-28T12:41:34.554 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.546+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.554 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.546+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.554 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.546+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.554 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.546+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.554 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.546+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.554 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.546+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.555 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.546+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.555 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.555 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.555 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.555 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.556 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.556 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.556 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.556 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 10 manifest: total_size = 12695 2020-04-28T12:41:34.556 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.72 2020-04-28T12:41:34.557 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.557 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.557 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.547+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.1499 2020-04-28T12:41:34.558 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.550+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.550+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.559 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.551+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.560 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.561 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 10 manifest: total_size = 8635 2020-04-28T12:41:34.561 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.323 2020-04-28T12:41:34.561 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.561 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.561 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.552+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.1735 2020-04-28T12:41:34.562 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.555+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.563 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.555+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.563 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.555+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.563 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.555+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.563 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.555+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.563 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.555+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.563 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.564 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.564 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.564 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.564 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.564 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.564 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.564 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.556+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.557+0000 7f2143156180 10 manifest: total_size = 7545 2020-04-28T12:41:34.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.557+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.87 2020-04-28T12:41:34.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.557+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55bc5dc585c8 s->prefetch_data=0 2020-04-28T12:41:34.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.557+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc585c8 2020-04-28T12:41:34.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.557+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1.1841 2020-04-28T12:41:34.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.560+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.560+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.560+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.560+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.560+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.560+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:34.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.560+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:34.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:34.568 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:41:34.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:41:34.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:34.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:34.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:34.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:34.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-conf[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:34.569 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.561+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:34.576 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.571+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x55bc5dae2370 msgr2=0x7f21140660f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:34.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.647+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f212403ea70 msgr2=0x7f212403e4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:34.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.674+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x55bc5dae9a20 msgr2=0x7f21140681d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:34.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.682+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:34.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.682+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:34.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.683+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:34.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.683+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:34.718 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.713+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f2128018780 msgr2=0x7f2114067d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:34.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.778+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114067d70 msgr2=0x7f21140766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:34.806 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-conf state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:34.806 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:34.807 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2020-04-28T12:41:34.807 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:41:34.807 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:34.808 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:34.808 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:34.808 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-conf from cache 2020-04-28T12:41:34.808 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.802+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2020-04-28T12:41:34.808 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.803+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94267512531600 notifier 4906 bl.length()=162 2020-04-28T12:41:34.809 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.805+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.1 from cache 2020-04-28T12:41:34.809 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.805+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=219 2020-04-28T12:41:34.810 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:34.805+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94267513990944 notifier 4906 bl.length()=219 2020-04-28T12:41:35.205 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.200+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:35.205 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.200+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:41:35.206 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2020-04-28T12:41:35.206 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:41:35.206 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:35.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:35.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:35.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:35.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=229 2020-04-28T12:41:35.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2020-04-28T12:41:35.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:41:35.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:35.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.201+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 : miss 2020-04-28T12:41:35.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 info.flags=0x16 2020-04-28T12:41:35.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 to cache LRU end 2020-04-28T12:41:35.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:35.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:35.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:35.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:35.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:35.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:35.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.202+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:35.210 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.203+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=322 2020-04-28T12:41:35.210 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.203+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 info.flags=0x13 2020-04-28T12:41:35.210 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.203+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 to cache LRU end 2020-04-28T12:41:35.210 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.203+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:35.217 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.203+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:35.217 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.203+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 2020-04-28T12:41:35.272 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.267+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f212c0059f0 msgr2=0x7f212c005e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:35.327 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.322+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2]) start_after [] num_entries 1100 2020-04-28T12:41:35.674 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.669+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:35.807 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.802+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:35.961 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:35.956+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:41:36.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.370+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55bc5dd19b48 s->prefetch_data=0 2020-04-28T12:41:36.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.371+0000 7f2143156180 10 manifest: total_size = 18874368 2020-04-28T12:41:36.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.371+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.20 2020-04-28T12:41:36.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.371+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55bc5dd19b48 s->prefetch_data=0 2020-04-28T12:41:36.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.371+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd19b48 2020-04-28T12:41:36.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.371+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2.1201 2020-04-28T12:41:36.379 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.375+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:41:36.379 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.375+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:36.380 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.375+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:36.380 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.375+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:41:36.380 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.375+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:41:36.380 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.375+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:41:36.380 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.375+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:36.381 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:36.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:41:36.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:41:36.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:36.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:36.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:36.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:36.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:36.383 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:36.383 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:36.383 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:36.383 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:41:36.383 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:36.383 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:41:36.384 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:41:36.384 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2020-04-28T12:41:36.384 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:41:36.384 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2020-04-28T12:41:36.384 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.376+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.20 2020-04-28T12:41:36.385 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.377+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:36.385 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.377+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-complete.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:36.385 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.378+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:36.455 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.450+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.460 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.455+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f21140681d0 msgr2=0x7f2114075b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.462 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.457+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f211406a2e0 msgr2=0x7f2114069c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.492+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211405f880 msgr2=0x7f21140669a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.501 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.497+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:36.501 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.497+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:36.502 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.497+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:36.502 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.497+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:36.525 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.520+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x55bc5dae2370 msgr2=0x7f21140660f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.525+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114069c60 msgr2=0x7f211406ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.591 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.586+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140766b0 msgr2=0x7f21140674f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.604 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.599+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114067110 msgr2=0x7f2114076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.604 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.599+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114067110 msgr2=0x7f2114076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.613 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.608+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x55bc5dae2370 msgr2=0x7f211406a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:36.615 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.610+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114069c60 msgr2=0x7f21140660f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.644+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:36.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.644+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:36.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2020-04-28T12:41:36.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:41:36.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:36.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:36.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:36.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2020-04-28T12:41:36.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2020-04-28T12:41:36.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.645+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94267513983664 notifier 4906 bl.length()=191 2020-04-28T12:41:36.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.647+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2 from cache 2020-04-28T12:41:36.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.647+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=248 2020-04-28T12:41:36.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.648+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94267513938384 notifier 4906 bl.length()=248 2020-04-28T12:41:36.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.701+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f21140766b0 msgr2=0x7f21140674f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:36.870 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:36.865+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x55bc5dae2370 msgr2=0x7f211406a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:37.012 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.007+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114069420 msgr2=0x7f2114065c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:37.058 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.053+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:37.058 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.053+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:41:37.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2020-04-28T12:41:37.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:41:37.059 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:37.060 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:37.060 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:37.060 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:37.060 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=236 2020-04-28T12:41:37.060 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2020-04-28T12:41:37.061 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:41:37.061 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:37.061 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.054+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 : miss 2020-04-28T12:41:37.062 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 info.flags=0x16 2020-04-28T12:41:37.062 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 to cache LRU end 2020-04-28T12:41:37.062 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:37.065 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:37.065 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:37.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:37.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:37.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:37.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.055+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:37.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.056+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=329 2020-04-28T12:41:37.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.056+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 info.flags=0x13 2020-04-28T12:41:37.066 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.056+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 to cache LRU end 2020-04-28T12:41:37.067 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.056+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:37.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.056+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:37.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.056+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 2020-04-28T12:41:37.110 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.105+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:37.115 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.110+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f21140660f0 msgr2=0x7f21140664d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:37.142 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.137+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067110 msgr2=0x7f2114076230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:37.177 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.172+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140660f0 msgr2=0x7f21140664d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:37.191 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.186+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3]) start_after [] num_entries 1100 2020-04-28T12:41:37.727 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.723+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114076230 msgr2=0x7f211406b240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:37.805 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:37.800+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:41:38.061 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.056+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x55bc5dae2370 msgr2=0x7f211406a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.092 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.087+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140664d0 msgr2=0x7f211407e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.212 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.207+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55bc5dd8b628 s->prefetch_data=0 2020-04-28T12:41:38.212 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.207+0000 7f2143156180 10 manifest: total_size = 26080 2020-04-28T12:41:38.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.207+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.40 2020-04-28T12:41:38.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.207+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55bc5dd8b628 s->prefetch_data=0 2020-04-28T12:41:38.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.207+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd8b628 2020-04-28T12:41:38.214 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.207+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3.1201 2020-04-28T12:41:38.218 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.210+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:41:38.218 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.210+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:38.218 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:38.219 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:41:38.219 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:41:38.219 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:41:38.219 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:38.220 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:38.220 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:41:38.220 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:41:38.220 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:38.220 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:38.221 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:38.221 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2020-04-28T12:41:38.221 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2020-04-28T12:41:38.221 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2020-04-28T12:41:38.221 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2020-04-28T12:41:38.222 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7670 2020-04-28T12:41:38.222 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7671 2020-04-28T12:41:38.222 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2020-04-28T12:41:38.222 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=7671 2020-04-28T12:41:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2020-04-28T12:41:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2020-04-28T12:41:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6314469 part_ofs=23013 rule->part_size=3067 2020-04-28T12:41:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2020-04-28T12:41:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.211+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.40 2020-04-28T12:41:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.213+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.213+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-update-complete.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:38.224 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.213+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:38.240 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.235+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114076230 msgr2=0x7f21140669a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.282 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.277+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140664d0 msgr2=0x7f211407e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:38.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.335+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:38.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.335+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:38.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.336+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:38.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.336+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:38.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.362+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140766b0 msgr2=0x7f211407e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:38.378 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.373+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.385 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.380+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140664d0 msgr2=0x7f211407caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:38.397 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.382+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.418 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.413+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f211407b6b0 msgr2=0x7f2114068fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.453 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.448+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:38.453 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.448+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:38.454 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2020-04-28T12:41:38.454 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:41:38.454 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:38.454 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:38.454 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:38.455 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2020-04-28T12:41:38.455 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2020-04-28T12:41:38.455 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.449+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94267513938384 notifier 4906 bl.length()=198 2020-04-28T12:41:38.456 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.451+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3 from cache 2020-04-28T12:41:38.456 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.451+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=255 2020-04-28T12:41:38.457 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.452+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94267513983664 notifier 4906 bl.length()=255 2020-04-28T12:41:38.465 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.460+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f21140664d0 msgr2=0x7f211407caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.707+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211407d580 msgr2=0x7f2114065c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.873 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.868+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:38.873 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.868+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:41:38.875 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2020-04-28T12:41:38.875 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:41:38.875 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:38.876 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:38.876 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:38.876 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:38.876 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=231 2020-04-28T12:41:38.876 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2020-04-28T12:41:38.876 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:41:38.876 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:38.877 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.869+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 : miss 2020-04-28T12:41:38.877 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 info.flags=0x16 2020-04-28T12:41:38.877 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 to cache LRU end 2020-04-28T12:41:38.877 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:38.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:38.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:38.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:38.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:38.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:38.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:38.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=324 2020-04-28T12:41:38.879 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 info.flags=0x13 2020-04-28T12:41:38.879 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 to cache LRU end 2020-04-28T12:41:38.879 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:38.879 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.870+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:38.879 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.871+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 2020-04-28T12:41:38.891 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.885+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211407d580 msgr2=0x7f2114065c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.891 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.885+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211407d580 msgr2=0x7f2114065c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.914 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.909+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.950 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.946+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140664d0 msgr2=0x7f211407afb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:38.996 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:38.991+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4]) start_after [] num_entries 1100 2020-04-28T12:41:39.443 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:39.438+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f21140664d0 msgr2=0x7f2114075cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:39.605 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:39.601+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo[ZtmJdV0WO3oAQbiYQapbOIFdj7OiecV] 2020-04-28T12:41:39.607 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:39.602+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211407b6b0 msgr2=0x7f2114068fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:39.661 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:39.650+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140681d0 msgr2=0x7f2114068b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:39.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:39.680+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f211407b6b0 msgr2=0x7f2114068fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.012 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.007+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.012 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.007+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55bc5dd19b48 s->prefetch_data=0 2020-04-28T12:41:40.013 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.008+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to 3k5sm622es65gelpujxn5nbxhd82grfu 2020-04-28T12:41:40.013 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.008+0000 7f2143156180 20 get_obj_state_impl: setting s->olh_tag to 2bor14bt8asi92qwv2z3mjaoekeqivbh 2020-04-28T12:41:40.013 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.008+0000 7f2143156180 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2bor14bt8asi92qwv2z3mjaoekeqivbh 2020-04-28T12:41:40.014 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.009+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.011+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.011+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 20 olh_log_entry: epoch=3 op=2 key=[] 2020-04-28T12:41:40.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 20 olh_log_entry: epoch=3 op=3 key=foo[ZtmJdV0WO3oAQbiYQapbOIFdj7OiecV] 2020-04-28T12:41:40.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-index-versioning.1:_:ZtmJdV0WO3oAQbiYQapbOIFdj7OiecV_foo state=0x55bc5dcbec28 s->prefetch_data=0 2020-04-28T12:41:40.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 10 manifest: total_size = 18874368 2020-04-28T12:41:40.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.55 2020-04-28T12:41:40.018 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-index-versioning.1:_:ZtmJdV0WO3oAQbiYQapbOIFdj7OiecV_foo state=0x55bc5dcbec28 s->prefetch_data=0 2020-04-28T12:41:40.018 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcbec28 2020-04-28T12:41:40.018 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.012+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.022 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.015+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:41:40.022 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.015+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:40.022 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:40.022 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:41:40.023 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:41:40.023 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:41:40.023 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:40.023 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:40.023 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:41:40.023 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:41:40.024 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:40.024 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:40.024 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:40.024 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:40.024 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:40.024 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:40.024 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:40.025 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:40.025 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:41:40.025 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:40.025 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:41:40.025 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:41:40.025 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2020-04-28T12:41:40.026 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:41:40.026 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2020-04-28T12:41:40.026 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.016+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.55 2020-04-28T12:41:40.026 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.019+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.027 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.019+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.027 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.022+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.035 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.023+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4.1201 2020-04-28T12:41:40.035 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.023+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:40.035 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.023+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:40.035 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:40.036 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:41:40.036 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:41:40.036 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:40.036 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:40.036 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:40.036 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:41:40.037 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:41:40.037 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:40.037 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:40.037 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:40.037 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:40.037 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.024+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-index-versioning.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:40.038 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.025+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:40.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.077+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211407c830 msgr2=0x7f2114075890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.089 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.084+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f211405f880 msgr2=0x7f211406ab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:40.145 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.140+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:40.146 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.140+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:40.146 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.141+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:40.146 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.141+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:40.146 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.142+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140664d0 msgr2=0x7f2114075cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:40.164 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.159+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f21140766b0 msgr2=0x7f21140669a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.178 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.173+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.186 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.181+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211405f880 msgr2=0x7f211406aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.230 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.226+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211407cff0 msgr2=0x7f2114065c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.248 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.243+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f211407cff0 msgr2=0x7f2114065c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:40.270 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.265+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:40.270 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.265+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:40.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2020-04-28T12:41:40.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:41:40.272 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:40.272 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:40.272 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:40.272 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2020-04-28T12:41:40.272 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2020-04-28T12:41:40.272 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.266+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94267513938384 notifier 4906 bl.length()=193 2020-04-28T12:41:40.273 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.268+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4 from cache 2020-04-28T12:41:40.273 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.268+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=250 2020-04-28T12:41:40.273 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.269+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94267513942960 notifier 4906 bl.length()=250 2020-04-28T12:41:40.293 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.288+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140681d0 msgr2=0x7f2114068b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.490+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.507 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.502+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f2114068fb0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.580 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.575+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f211406de70 msgr2=0x7f211407af50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.683 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:40.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:41:40.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2020-04-28T12:41:40.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:41:40.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:40.690 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:40.690 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:40.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.679+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:40.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:41:40.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2020-04-28T12:41:40.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:41:40.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:40.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 : miss 2020-04-28T12:41:40.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 info.flags=0x16 2020-04-28T12:41:40.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 to cache LRU end 2020-04-28T12:41:40.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:40.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:40.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:40.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:40.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:40.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:40.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.680+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:40.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.681+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:41:40.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.681+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 info.flags=0x13 2020-04-28T12:41:40.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.681+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 to cache LRU end 2020-04-28T12:41:40.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.681+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:40.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.681+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:40.694 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.681+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 2020-04-28T12:41:40.721 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.716+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f211407c830 msgr2=0x7f2114075890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.753 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.749+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211405ca60 msgr2=0x7f211405ee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:40.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.753+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f211407cff0 msgr2=0x7f211407c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:40.761 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.756+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114068b50 msgr2=0x7f211406e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.766 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.761+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f211407c830 msgr2=0x7f2114075890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.816 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.811+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5]) start_after [] num_entries 1100 2020-04-28T12:41:40.850 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.845+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140766b0 msgr2=0x7f2114066970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.859 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.854+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114068fb0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.930 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.925+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140681d0 msgr2=0x7f211406de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:40.962 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:40.957+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f2114068b50 msgr2=0x7f211406e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.065 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.061+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211407cff0 msgr2=0x7f211407c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.186 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.181+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.199+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f2114072b80 msgr2=0x7f211405ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.210 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.205+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211407cff0 msgr2=0x7f211406ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.434 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.429+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:41:41.839 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.834+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:41.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.835+0000 7f2143156180 10 manifest: total_size = 18874368 2020-04-28T12:41:41.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.835+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.71 2020-04-28T12:41:41.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.835+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:41.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.835+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:41.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.835+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5.1201 2020-04-28T12:41:41.842 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.838+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:41:41.842 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.838+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:41.844 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.838+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:41.844 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.838+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:41:41.844 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.838+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:41:41.844 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.838+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:41:41.844 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.838+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:41.845 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:41.845 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:41:41.845 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:41:41.845 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:41.845 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:41.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:41.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:41.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:41.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:41.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:41.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:41.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:41:41.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:41.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2020-04-28T12:41:41.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:41:41.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2020-04-28T12:41:41.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2020-04-28T12:41:41.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2020-04-28T12:41:41.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.839+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.71 2020-04-28T12:41:41.848 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.840+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:41.848 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.840+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-simple.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:41.848 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.840+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:41.850 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.845+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114068fb0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.869 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.864+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.874+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f21140664d0 msgr2=0x7f2114075cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.897 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.892+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211407cff0 msgr2=0x7f211406ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.919 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.914+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f211407c830 msgr2=0x7f2114075890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.939 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.935+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f211407cff0 msgr2=0x7f2114075cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.967 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.962+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:41.967 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.962+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:41.967 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.962+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:41.968 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.962+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:41.975 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.970+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:41.988 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:41.983+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f211407c830 msgr2=0x7f2114075690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:42.047 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.042+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:42.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.076+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:42.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.076+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:42.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2020-04-28T12:41:42.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:41:42.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:42.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:42.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:42.083 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2020-04-28T12:41:42.083 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2020-04-28T12:41:42.083 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.077+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94267513984832 notifier 4906 bl.length()=183 2020-04-28T12:41:42.084 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.079+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5 from cache 2020-04-28T12:41:42.084 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.079+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=240 2020-04-28T12:41:42.084 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.079+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94267513986144 notifier 4906 bl.length()=240 2020-04-28T12:41:42.129 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.124+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140681d0 msgr2=0x7f211407c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:42.276 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.269+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:42.484 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.479+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:42.484 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.479+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:41:42.485 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2020-04-28T12:41:42.486 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:42.486 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:42.486 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:42.486 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:42.486 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:42.486 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=227 2020-04-28T12:41:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2020-04-28T12:41:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.480+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 : miss 2020-04-28T12:41:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 info.flags=0x16 2020-04-28T12:41:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 to cache LRU end 2020-04-28T12:41:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:42.488 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:42.488 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:42.488 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:42.488 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:42.488 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:42.488 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:42.489 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=320 2020-04-28T12:41:42.489 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 info.flags=0x13 2020-04-28T12:41:42.489 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 to cache LRU end 2020-04-28T12:41:42.490 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:42.490 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:42.490 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.481+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 2020-04-28T12:41:42.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.525+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:42.566 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.561+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f21140681d0 msgr2=0x7f211407c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:42.573 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.568+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211407c830 msgr2=0x7f211407b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:42.644 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.639+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7]) start_after [] num_entries 1100 2020-04-28T12:41:42.711 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.706+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:41:42.741 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.736+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:41:42.746 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.741+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:41:42.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.763+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f2114072b80 msgr2=0x7f2114071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:42.878 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.873+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140766b0 msgr2=0x7f2114075660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:42.911 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.906+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:41:42.977 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:42.973+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:41:43.104 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.099+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114072b80 msgr2=0x7f2114071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:43.114 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.110+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f21140766b0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:43.156 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.151+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:41:43.238 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.234+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:41:43.258 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.253+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:41:43.400 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.396+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:41:43.410 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.405+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:41:43.414 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.407+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211407c830 msgr2=0x7f211407b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:43.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.493+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140766b0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:43.512 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.508+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:41:43.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.527+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:41:43.708 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.703+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.704+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.704+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.112 2020-04-28T12:41:43.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.704+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.704+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.704+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.126 2020-04-28T12:41:43.711 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.707+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:41:43.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.707+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.713 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.707+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.713 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.707+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.713 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.707+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.713 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.707+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:41:43.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.707+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.708+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.112 2020-04-28T12:41:43.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.710+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.711+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.711+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.114 2020-04-28T12:41:43.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.711+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.711+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.717 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.711+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.182 2020-04-28T12:41:43.719 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.714+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.719 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.714+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.720 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.720 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.720 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.720 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.720 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.721 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.721 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.721 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.721 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.722 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.722 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.722 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.722 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.722 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.715+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.114 2020-04-28T12:41:43.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.725+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.725+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211407c830 msgr2=0x7f2114072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:43.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.726+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.726+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _13aWve8zq4EYlpagp3bSy0qm1Isoed_ 2020-04-28T12:41:43.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.726+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.732 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.726+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.732 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.726+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.192 2020-04-28T12:41:43.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.732+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.732+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.732+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.732+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.732+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.732+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.732+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.739 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.739 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.739 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.739 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.739 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.740 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.740 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.733+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _13aWve8zq4EYlpagp3bSy0qm1Isoed_ 2020-04-28T12:41:43.741 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.734+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.741 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.734+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.741 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.734+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.108 2020-04-28T12:41:43.741 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.734+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.741 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.734+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.741 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.734+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.501 2020-04-28T12:41:43.742 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.738+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.742 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.738+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.738+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.738+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.738+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.738+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.738+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.746 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.746 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.739+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.108 2020-04-28T12:41:43.746 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.740+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.747 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.741+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.747 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.741+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _3_0XLj2BQgFnvcEZnyb1_zyExCBJxbC 2020-04-28T12:41:43.747 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.741+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.747 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.741+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.747 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.741+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.625 2020-04-28T12:41:43.748 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.744+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.749 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.744+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.744+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.744+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.744+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.744+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.744+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.752 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.745+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _3_0XLj2BQgFnvcEZnyb1_zyExCBJxbC 2020-04-28T12:41:43.752 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.746+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.752 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.747+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.753 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.747+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _z69KIc8QEqgY_aiw8Ym0oFBAfewt4nE 2020-04-28T12:41:43.753 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.747+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.753 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.747+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.753 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.747+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.965 2020-04-28T12:41:43.754 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.750+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.754 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.750+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.755 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.750+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.750+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.750+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.750+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.750+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.757 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.758 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.751+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _z69KIc8QEqgY_aiw8Ym0oFBAfewt4nE 2020-04-28T12:41:43.758 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.752+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.758 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.753+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.759 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.753+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _qhdwdvJeDH-qYWW7bzzpd4H2iOB27R_ 2020-04-28T12:41:43.759 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.753+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.759 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.753+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.759 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.753+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.1116 2020-04-28T12:41:43.760 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.755+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.760 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.755+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.760 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.761 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.761 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.761 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.761 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.762 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.762 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.762 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.762 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.762 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.763 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.763 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.763 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.763 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.756+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _qhdwdvJeDH-qYWW7bzzpd4H2iOB27R_ 2020-04-28T12:41:43.764 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.758+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.764 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.758+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.764 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.758+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.119 2020-04-28T12:41:43.764 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.758+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.764 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.758+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.765 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.758+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.1151 2020-04-28T12:41:43.766 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.761+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.766 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.761+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.766 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.761+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.766 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.761+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.767 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.761+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.767 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.761+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.767 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.761+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.769 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.769 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.769 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.762+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.119 2020-04-28T12:41:43.769 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.763+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.770 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.764+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.770 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.764+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _Uqc_IxLsshWqjXvXW7SfwO-zy_IKNEf 2020-04-28T12:41:43.770 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.764+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.770 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.764+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.770 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.764+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.1419 2020-04-28T12:41:43.771 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.767+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.771 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.767+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.772 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.767+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.772 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.767+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.772 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.767+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.772 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.767+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.773 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.767+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.773 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.768+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _Uqc_IxLsshWqjXvXW7SfwO-zy_IKNEf 2020-04-28T12:41:43.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.769+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.770+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.770+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.116 2020-04-28T12:41:43.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.770+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.770+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.770+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.1438 2020-04-28T12:41:43.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.773+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.773+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.773+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.773+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.773+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.773+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.773+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.774+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.116 2020-04-28T12:41:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.775+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.775+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.775+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _0Kvaboie-rx9i-C4UyhP6guqISugPqZ 2020-04-28T12:41:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.775+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55bc5dc6efa8 s->prefetch_data=0 2020-04-28T12:41:43.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.775+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dc6efa8 2020-04-28T12:41:43.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.775+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.1634 2020-04-28T12:41:43.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.778+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.778+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.786 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.786 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.786 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.779+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _0Kvaboie-rx9i-C4UyhP6guqISugPqZ 2020-04-28T12:41:43.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.781+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55bc5ddc0168 s->prefetch_data=0 2020-04-28T12:41:43.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.781+0000 7f2143156180 10 manifest: total_size = 5242880 2020-04-28T12:41:43.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.781+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.109 2020-04-28T12:41:43.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.781+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55bc5ddc0168 s->prefetch_data=0 2020-04-28T12:41:43.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.781+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5ddc0168 2020-04-28T12:41:43.788 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.781+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7.1668 2020-04-28T12:41:43.788 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.784+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.789 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.784+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.789 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.784+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.789 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.784+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.789 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:43.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:43.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:43.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:41:43.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:43.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:43.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:43.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:43.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:43.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:41:43.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.785+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.109 2020-04-28T12:41:43.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.787+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:43.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.787+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-copy.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:43.793 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.787+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:43.807 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.802+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f211407cff0 msgr2=0x7f211406de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:43.852 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.847+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:43.853 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.848+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211407c830 msgr2=0x7f2114072400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:43.915 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.910+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114068b50 msgr2=0x7f211407b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:43.934 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.929+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:43.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.929+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:43.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.930+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:43.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:43.930+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:44.080 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.075+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:44.080 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.075+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:44.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.075+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2020-04-28T12:41:44.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.075+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:41:44.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.075+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:44.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.075+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:44.081 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.076+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:44.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.076+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2020-04-28T12:41:44.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.076+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2020-04-28T12:41:44.082 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.076+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94267513938384 notifier 4906 bl.length()=189 2020-04-28T12:41:44.083 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.078+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7 from cache 2020-04-28T12:41:44.083 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.078+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=246 2020-04-28T12:41:44.083 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.078+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94267513942960 notifier 4906 bl.length()=246 2020-04-28T12:41:44.103 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.094+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140766b0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:44.106 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.101+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114072b80 msgr2=0x7f211407af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:44.477 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:44.478 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:41:44.479 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2020-04-28T12:41:44.479 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:44.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:44.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:44.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:44.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.473+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:44.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=237 2020-04-28T12:41:44.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2020-04-28T12:41:44.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:44.481 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:44.481 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 : miss 2020-04-28T12:41:44.481 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 info.flags=0x16 2020-04-28T12:41:44.481 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 to cache LRU end 2020-04-28T12:41:44.481 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:44.481 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:44.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:44.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:44.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:44.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:44.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.474+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.475+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=330 2020-04-28T12:41:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.475+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 info.flags=0x13 2020-04-28T12:41:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.475+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 to cache LRU end 2020-04-28T12:41:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.475+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.475+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:44.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.475+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 2020-04-28T12:41:44.565 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.560+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114068b50 msgr2=0x7f2114075b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:44.599 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.594+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9]) start_after [] num_entries 1100 2020-04-28T12:41:44.601 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.597+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114072b80 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:44.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.660+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:41:44.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.681+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:44.694 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.689+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:41:44.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.694+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:41:44.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.853+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:41:44.921 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:44.916+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:41:45.102 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.097+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:41:45.192 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.188+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:41:45.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.205+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:41:45.315 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.310+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f21140766b0 msgr2=0x7f211405ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:45.348 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.343+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:41:45.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.353+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:41:45.443 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.438+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114072b80 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:45.457 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.453+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:41:45.469 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.464+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140674f0 msgr2=0x7f211407c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:45.476 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.471+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:41:45.573 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.569+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:45.644 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.640+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.645 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.640+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.645 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.640+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.234 2020-04-28T12:41:45.645 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.640+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.645 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.640+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.646 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.640+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.126 2020-04-28T12:41:45.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.643+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:41:45.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.643+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:41:45.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:45.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:41:45.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:41:45.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.644+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.234 2020-04-28T12:41:45.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.646+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.646+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.646+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.236 2020-04-28T12:41:45.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.646+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.646+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.654 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.646+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.182 2020-04-28T12:41:45.654 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.649+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.654 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.649+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:45.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.658 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.658 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.658 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:41:45.658 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.658 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:41:45.658 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.650+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.236 2020-04-28T12:41:45.659 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.652+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.659 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.652+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.659 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.652+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _P2IDxroA8mUJsO3fzJISrWbBIfhTGZe 2020-04-28T12:41:45.660 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.652+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.660 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.652+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.660 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.652+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.192 2020-04-28T12:41:45.660 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.655+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.661 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.655+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.661 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.656+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.662 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.656+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.662 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.656+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.662 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.656+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.662 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.656+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.662 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.662 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.663 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.663 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.666 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.666 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.666 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.657+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _P2IDxroA8mUJsO3fzJISrWbBIfhTGZe 2020-04-28T12:41:45.667 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.658+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.667 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.659+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.659+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.225 2020-04-28T12:41:45.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.659+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.659+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.659+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.501 2020-04-28T12:41:45.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.661+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.661+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:45.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:41:45.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:41:45.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.662+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.225 2020-04-28T12:41:45.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.664+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.664+0000 7f2143156180 10 manifest: total_size = 1140 2020-04-28T12:41:45.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.664+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _D3JdJu4lh0nY4EVSQasfoDXsjoAhDMw 2020-04-28T12:41:45.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.664+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.664+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.664+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.625 2020-04-28T12:41:45.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.667+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.667+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.674 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.674 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.674 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.674 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.668+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _D3JdJu4lh0nY4EVSQasfoDXsjoAhDMw 2020-04-28T12:41:45.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.669+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.670+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.677 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.670+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _nwDy4BJ1x48K6b7K-8qOweQh8Hducm3 2020-04-28T12:41:45.677 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.670+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.677 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.670+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.677 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.670+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.965 2020-04-28T12:41:45.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.673+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.673+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.673+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.673+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.673+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.673+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.673+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.674+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _nwDy4BJ1x48K6b7K-8qOweQh8Hducm3 2020-04-28T12:41:45.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.675+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.676+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.676+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _f-0hs1H_Y2aOjiDgHpEn4zkd5Wow4eK 2020-04-28T12:41:45.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.676+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.676+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.683 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.676+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.1116 2020-04-28T12:41:45.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.679+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.679+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.680+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _f-0hs1H_Y2aOjiDgHpEn4zkd5Wow4eK 2020-04-28T12:41:45.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.682+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.682+0000 7f2143156180 10 manifest: total_size = 1140 2020-04-28T12:41:45.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.682+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.246 2020-04-28T12:41:45.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.682+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.682+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.682+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.1151 2020-04-28T12:41:45.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.685+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.690 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.685+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.690 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.690 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.692 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:41:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=515 2020-04-28T12:41:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2020-04-28T12:41:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:41:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291971 part_ofs=515 rule->part_size=515 2020-04-28T12:41:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=110 2020-04-28T12:41:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=110 rules.size()=2 2020-04-28T12:41:45.694 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6292486 part_ofs=1030 rule->part_size=110 2020-04-28T12:41:45.694 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=1140 rule->part_size=110 2020-04-28T12:41:45.694 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.686+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.246 2020-04-28T12:41:45.695 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.687+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.695 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.688+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.695 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.688+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _GEtcd73BUxqcgwHkMvwEQRS3wJBzUSB 2020-04-28T12:41:45.695 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.688+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.695 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.688+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.695 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.688+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.1419 2020-04-28T12:41:45.697 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.691+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.697 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.691+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.697 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.691+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.697 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.691+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.697 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.691+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.698 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.691+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.698 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.691+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.698 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.698 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.698 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.698 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.692+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _GEtcd73BUxqcgwHkMvwEQRS3wJBzUSB 2020-04-28T12:41:45.700 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.694+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.700 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.694+0000 7f2143156180 10 manifest: total_size = 1140 2020-04-28T12:41:45.700 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.694+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.243 2020-04-28T12:41:45.700 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.694+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.701 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.694+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.701 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.694+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.1438 2020-04-28T12:41:45.701 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.697+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.702 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.697+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.702 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.697+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.702 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.697+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.702 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.697+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.703 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.697+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.703 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.697+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.704 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.704 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.704 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.704 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.704 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:41:45.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=515 2020-04-28T12:41:45.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2020-04-28T12:41:45.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:41:45.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291971 part_ofs=515 rule->part_size=515 2020-04-28T12:41:45.705 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=110 2020-04-28T12:41:45.706 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=110 rules.size()=2 2020-04-28T12:41:45.706 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6292486 part_ofs=1030 rule->part_size=110 2020-04-28T12:41:45.706 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=1140 rule->part_size=110 2020-04-28T12:41:45.706 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.698+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.243 2020-04-28T12:41:45.706 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.699+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.707 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.700+0000 7f2143156180 10 manifest: total_size = 1140 2020-04-28T12:41:45.707 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.700+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to _dWC4T7WUVNMOkv17CKs98RyOdfg5xp- 2020-04-28T12:41:45.707 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.700+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.707 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.700+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.708 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.700+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.1634 2020-04-28T12:41:45.708 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.702+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.708 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.702+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.703+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.703+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.703+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.703+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.703+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.710 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:45.711 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=0 rule->part_size=0 2020-04-28T12:41:45.711 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.704+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _dWC4T7WUVNMOkv17CKs98RyOdfg5xp- 2020-04-28T12:41:45.711 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.705+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.705+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:45.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.705+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.226 2020-04-28T12:41:45.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.705+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55bc5dd20028 s->prefetch_data=0 2020-04-28T12:41:45.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.705+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dd20028 2020-04-28T12:41:45.712 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.705+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9.1668 2020-04-28T12:41:45.713 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.708+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.713 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.708+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:45.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:45.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:45.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:41:45.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:45.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:45.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:45.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:45.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:45.717 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:45.717 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.717 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:41:45.717 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:45.717 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:41:45.717 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.709+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.226 2020-04-28T12:41:45.718 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.711+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:45.718 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.711+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart-copy.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:45.718 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.711+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:45.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.780+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211407cff0 msgr2=0x7f21140668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:45.833 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.828+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:45.833 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.828+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:45.833 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.828+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:45.833 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.828+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:45.851 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.846+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:45.875 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.870+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:45.901 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.896+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140766b0 msgr2=0x7f211405ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:45.917 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.912+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140766b0 msgr2=0x7f211405ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:45.955 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.950+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:45.955 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.950+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:45.956 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2020-04-28T12:41:45.956 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:41:45.956 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:45.957 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:45.957 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:45.957 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2020-04-28T12:41:45.957 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2020-04-28T12:41:45.957 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.951+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94267513942960 notifier 4906 bl.length()=199 2020-04-28T12:41:45.958 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.953+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9 from cache 2020-04-28T12:41:45.958 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.953+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=256 2020-04-28T12:41:45.958 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:45.954+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94267513984832 notifier 4906 bl.length()=256 2020-04-28T12:41:46.031 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.026+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114072b80 msgr2=0x7f211406b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.085 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.080+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140766b0 msgr2=0x7f211405ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.152 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.147+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.493 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.488+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:46.493 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.488+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:41:46.494 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.489+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2020-04-28T12:41:46.494 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.489+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:46.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.489+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:46.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.489+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:46.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.489+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:46.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.489+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:46.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=232 2020-04-28T12:41:46.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2020-04-28T12:41:46.495 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:46.496 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:46.496 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 : miss 2020-04-28T12:41:46.497 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 info.flags=0x16 2020-04-28T12:41:46.497 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 to cache LRU end 2020-04-28T12:41:46.497 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:46.497 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:46.497 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:46.497 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:46.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:46.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:46.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.490+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:46.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.491+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=325 2020-04-28T12:41:46.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.491+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 info.flags=0x13 2020-04-28T12:41:46.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.491+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 to cache LRU end 2020-04-28T12:41:46.499 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.491+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:46.499 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.491+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:46.499 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.491+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 2020-04-28T12:41:46.512 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.507+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.534+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140674f0 msgr2=0x7f2114085bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.571 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.566+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140766b0 msgr2=0x7f211405ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.592 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.587+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114072b80 msgr2=0x7f211406b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.593 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.588+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:46.596 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.592+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140766b0 msgr2=0x7f211406af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:46.634 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.629+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8]) start_after [] num_entries 1100 2020-04-28T12:41:46.700 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.695+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:41:46.897 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.893+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:41:46.956 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:46.952+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:47.128 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.123+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114068fb0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:47.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.369+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:41:47.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.661+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:47.667 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.661+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:47.667 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.661+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.204 2020-04-28T12:41:47.667 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.661+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:47.667 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.661+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc74d8 2020-04-28T12:41:47.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.661+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8.126 2020-04-28T12:41:47.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.664+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:41:47.669 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.665+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:47.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.665+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:47.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.665+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:41:47.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.665+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:47.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.665+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:41:47.670 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.665+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:47.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:47.671 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:41:47.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:47.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:47.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:47.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:47.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:47.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:41:47.673 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.666+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.204 2020-04-28T12:41:47.674 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.668+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:47.674 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.668+0000 7f2143156180 10 manifest: total_size = 11534336 2020-04-28T12:41:47.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.668+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.197 2020-04-28T12:41:47.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.668+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:47.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.668+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc74d8 2020-04-28T12:41:47.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.668+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8.501 2020-04-28T12:41:47.675 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.671+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:47.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.671+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:47.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.671+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:47.676 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.671+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:41:47.677 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.671+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:47.677 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.671+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:47.677 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.671+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:47.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:47.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:41:47.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:47.678 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:47.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:47.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:47.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:47.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:41:47.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:47.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:41:47.679 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:41:47.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:47.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:41:47.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:41:47.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:41:47.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.672+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.197 2020-04-28T12:41:47.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.674+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:47.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.674+0000 7f2143156180 10 manifest: total_size = 541681 2020-04-28T12:41:47.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.674+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.211 2020-04-28T12:41:47.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.674+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:47.681 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.674+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc74d8 2020-04-28T12:41:47.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.674+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8.1438 2020-04-28T12:41:47.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.678+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:47.682 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.678+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:47.683 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.678+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:47.683 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.678+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:41:47.683 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.678+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:47.683 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.678+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:47.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.678+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:47.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:47.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:41:47.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:47.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:47.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:47.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:47.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:41:47.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:41:47.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:41:47.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:41:47.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:41:47.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2020-04-28T12:41:47.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2020-04-28T12:41:47.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2020-04-28T12:41:47.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2020-04-28T12:41:47.686 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.679+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.211 2020-04-28T12:41:47.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.680+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:47.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.680+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:47.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.681+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:47.709 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.703+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f2114072b80 msgr2=0x7f211406b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:47.724 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.719+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140674f0 msgr2=0x7f211406ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:47.740 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.734+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140658b0 msgr2=0x7f21140668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:47.740 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.735+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140658b0 msgr2=0x7f21140668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:47.822 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.814+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:47.822 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.814+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:47.822 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.814+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:47.823 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.814+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:47.899 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.894+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114072b80 msgr2=0x7f211406b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:47.909 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.904+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114068fb0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:47.934 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:47.934 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:47.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2020-04-28T12:41:47.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:41:47.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:47.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:47.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:47.935 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2020-04-28T12:41:47.936 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.929+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2020-04-28T12:41:47.936 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.930+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94267513986144 notifier 4906 bl.length()=194 2020-04-28T12:41:47.936 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.932+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8 from cache 2020-04-28T12:41:47.936 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.932+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=251 2020-04-28T12:41:47.937 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:47.932+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94267513984832 notifier 4906 bl.length()=251 2020-04-28T12:41:48.335 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.330+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:48.335 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.330+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:41:48.336 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2020-04-28T12:41:48.336 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:48.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:48.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:48.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:48.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:48.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=222 2020-04-28T12:41:48.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2020-04-28T12:41:48.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:48.338 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:48.338 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.331+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 : miss 2020-04-28T12:41:48.339 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 info.flags=0x16 2020-04-28T12:41:48.339 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 to cache LRU end 2020-04-28T12:41:48.339 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:48.339 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:48.339 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:48.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:48.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:48.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:48.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.332+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:48.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.333+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=315 2020-04-28T12:41:48.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.333+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 info.flags=0x13 2020-04-28T12:41:48.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.333+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 to cache LRU end 2020-04-28T12:41:48.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.333+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:48.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.333+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:48.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.333+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 2020-04-28T12:41:48.406 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.401+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114068fb0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:48.472 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.467+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6]) start_after [] num_entries 1100 2020-04-28T12:41:48.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.531+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:41:48.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.533+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114068b50 msgr2=0x7f211406aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:48.680 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.675+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114068fb0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:48.733 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.727+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:41:48.844 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:48.839+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.021 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.016+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.050 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.045+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114072b80 msgr2=0x7f2114075130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.235 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.230+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:41:49.520 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.515+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f21140674f0 msgr2=0x7f211406e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.524 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.519+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55bc5dcf07b8 s->prefetch_data=0 2020-04-28T12:41:49.525 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.519+0000 7f2143156180 10 manifest: total_size = 10485760 2020-04-28T12:41:49.525 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.519+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.85 2020-04-28T12:41:49.525 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.519+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55bc5dcf07b8 s->prefetch_data=0 2020-04-28T12:41:49.525 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.519+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcf07b8 2020-04-28T12:41:49.526 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.520+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6.126 2020-04-28T12:41:49.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.523+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:41:49.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.523+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:49.529 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.523+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:49.529 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.523+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:41:49.529 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.523+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:49.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.523+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:41:49.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.523+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:49.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:49.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:41:49.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:49.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:49.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:49.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:49.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:49.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:41:49.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:49.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:41:49.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.524+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.85 2020-04-28T12:41:49.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.526+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55bc5dcf07b8 s->prefetch_data=0 2020-04-28T12:41:49.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.526+0000 7f2143156180 10 manifest: total_size = 10485760 2020-04-28T12:41:49.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.526+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.84 2020-04-28T12:41:49.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.526+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55bc5dcf07b8 s->prefetch_data=0 2020-04-28T12:41:49.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.526+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcf07b8 2020-04-28T12:41:49.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.526+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6.501 2020-04-28T12:41:49.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.529+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:49.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.529+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:49.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:49.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:41:49.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:49.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:49.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:49.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:49.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:41:49.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:49.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:49.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:49.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:49.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:49.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:41:49.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:41:49.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:41:49.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.530+0000 7f2143156180 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.84 2020-04-28T12:41:49.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.532+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55bc5dcf07b8 s->prefetch_data=0 2020-04-28T12:41:49.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.532+0000 7f2143156180 10 manifest: total_size = 649292 2020-04-28T12:41:49.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.532+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.86 2020-04-28T12:41:49.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.532+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55bc5dcf07b8 s->prefetch_data=0 2020-04-28T12:41:49.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.532+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcf07b8 2020-04-28T12:41:49.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.532+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6.1438 2020-04-28T12:41:49.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.535+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:49.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.535+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:49.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.537+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:49.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.537+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:41:49.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.537+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:49.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.537+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:49.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.537+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:49.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:49.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:41:49.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:49.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:49.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:49.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:49.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:49.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:49.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.538+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:49.620 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.615+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114068b50 msgr2=0x7f211407e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.643+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.651+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:49.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.651+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:49.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.651+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:49.657 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.651+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:49.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.711+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140766b0 msgr2=0x7f211405ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.718 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.713+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.725 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.720+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f21140658b0 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.729 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.723+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f2114065c90 msgr2=0x7f211405ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.731+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f2114065c90 msgr2=0x7f211405ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:49.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.765+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:49.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.765+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:49.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2020-04-28T12:41:49.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:41:49.783 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:49.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:49.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:49.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2020-04-28T12:41:49.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2020-04-28T12:41:49.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.766+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879303 cookie 94267513938384 notifier 4906 bl.length()=184 2020-04-28T12:41:49.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.768+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6 from cache 2020-04-28T12:41:49.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.768+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=241 2020-04-28T12:41:49.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:49.769+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94267513983664 notifier 4906 bl.length()=241 2020-04-28T12:41:50.200 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:50.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:41:50.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2020-04-28T12:41:50.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:50.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:50.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:50.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:50.201 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.186+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:50.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:41:50.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2020-04-28T12:41:50.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:50.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:50.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 : miss 2020-04-28T12:41:50.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 info.flags=0x16 2020-04-28T12:41:50.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 to cache LRU end 2020-04-28T12:41:50.203 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:50.203 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:50.203 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:50.203 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:50.203 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:50.203 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:50.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.187+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:50.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.188+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:41:50.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.188+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 info.flags=0x13 2020-04-28T12:41:50.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.188+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 to cache LRU end 2020-04-28T12:41:50.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.188+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:50.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.188+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:50.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.188+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 2020-04-28T12:41:50.230 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.225+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:50.273 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.268+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f211407cff0 msgr2=0x7f211406de70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:50.326 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.322+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10]) start_after [] num_entries 1100 2020-04-28T12:41:50.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.378+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:41:50.502 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.497+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:41:50.684 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.681+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:41:50.746 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:50.742+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f211406de70 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:51.135 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.130+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:41:51.347 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.343+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114065c90 msgr2=0x7f2114077610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:51.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.350+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.354 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.350+0000 7f2143156180 10 manifest: total_size = 0 2020-04-28T12:41:51.354 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.350+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.306 2020-04-28T12:41:51.354 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.350+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.355 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.350+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc6348 2020-04-28T12:41:51.355 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.350+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10.111 2020-04-28T12:41:51.357 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.353+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:41:51.357 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.353+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.358 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.358 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.358 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.358 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:41:51.358 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.359 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.359 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.359 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.359 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:51.360 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:51.360 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:51.360 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.354+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.360 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.355+0000 7f2143156180 10 manifest: total_size = 0 2020-04-28T12:41:51.361 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.355+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.305 2020-04-28T12:41:51.361 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.355+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.361 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.355+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc6348 2020-04-28T12:41:51.361 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.355+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10.349 2020-04-28T12:41:51.361 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.358+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:51.362 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.358+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.362 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.358+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.358+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.358+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.358+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:51.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.358+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.364 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.364 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:51.364 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:51.364 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:51.364 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.365 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 10 manifest: total_size = 0 2020-04-28T12:41:51.365 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.307 2020-04-28T12:41:51.365 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.365 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc6348 2020-04-28T12:41:51.365 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.359+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10.695 2020-04-28T12:41:51.366 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.362+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:51.366 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.362+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:51.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:51.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:51.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:51.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.363+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.369 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.364+0000 7f2143156180 10 manifest: total_size = 0 2020-04-28T12:41:51.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.364+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.308 2020-04-28T12:41:51.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.364+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55bc5dcc6348 s->prefetch_data=0 2020-04-28T12:41:51.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.364+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc6348 2020-04-28T12:41:51.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.364+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10.1557 2020-04-28T12:41:51.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.367+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:51.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.367+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.367+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.367+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.367+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.367+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:51.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.367+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:51.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:51.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:41:51.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:51.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:51.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:51.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:51.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:51.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.368+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:51.419 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.415+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:51.442 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.438+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:51.454 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.451+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f2114065c90 msgr2=0x7f2114077610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:51.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.494+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:51.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.494+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:51.498 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.494+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:51.499 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.494+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:51.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.533+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:51.556 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.552+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114065c90 msgr2=0x7f2114077610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:51.611 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:51.611 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:51.612 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2020-04-28T12:41:51.612 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:41:51.612 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:51.612 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:51.612 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:51.612 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2020-04-28T12:41:51.613 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.607+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:41:51.613 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.608+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94267513983664 notifier 4906 bl.length()=181 2020-04-28T12:41:51.620 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.610+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.10 from cache 2020-04-28T12:41:51.620 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.610+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2020-04-28T12:41:51.620 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.610+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94267513990944 notifier 4906 bl.length()=239 2020-04-28T12:41:51.699 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.695+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f21140674f0 msgr2=0x7f211406e2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:51.888 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:51.884+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:52.014 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:52.014 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:41:52.015 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2020-04-28T12:41:52.015 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:52.015 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:52.015 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:52.015 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:52.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.010+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:52.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:41:52.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2020-04-28T12:41:52.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:52.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:52.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 : miss 2020-04-28T12:41:52.016 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 info.flags=0x16 2020-04-28T12:41:52.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 to cache LRU end 2020-04-28T12:41:52.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:52.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:52.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:52.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:52.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:52.017 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:52.018 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.011+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:52.018 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.012+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:41:52.018 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.012+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 info.flags=0x13 2020-04-28T12:41:52.018 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.012+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 to cache LRU end 2020-04-28T12:41:52.019 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.012+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:52.019 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.012+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:52.019 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.012+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 2020-04-28T12:41:52.067 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.063+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x7f21140674f0 msgr2=0x7f211405ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:52.067 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.064+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211406de70 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:52.111 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.107+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114068b50 msgr2=0x7f211407e060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:52.139 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.136+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11]) start_after [] num_entries 1100 2020-04-28T12:41:52.196 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.192+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:41:52.252 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.248+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f2114068b50 msgr2=0x7f211407e060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:52.316 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.312+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:41:52.797 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:52.793+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:41:53.290 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.287+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:41:53.377 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.374+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.396 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.393+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f211406de70 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.462 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.458+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f21140658b0 msgr2=0x7f2114082ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:53.527 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.523+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.523+0000 7f2143156180 10 manifest: total_size = 524288 2020-04-28T12:41:53.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.523+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.313 2020-04-28T12:41:53.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.523+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.523+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dde62f8 2020-04-28T12:41:53.528 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.523+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11.111 2020-04-28T12:41:53.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.526+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:41:53.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.526+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:41:53.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.532 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:53.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:53.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:53.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.527+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.528+0000 7f2143156180 10 manifest: total_size = 2078 2020-04-28T12:41:53.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.528+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.312 2020-04-28T12:41:53.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.528+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.533 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.528+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dde62f8 2020-04-28T12:41:53.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.528+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11.349 2020-04-28T12:41:53.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.535+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:53.538 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.535+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.535+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.535+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.535+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.535+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:53.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.535+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:53.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:53.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:53.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 10 manifest: total_size = 62 2020-04-28T12:41:53.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.314 2020-04-28T12:41:53.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dde62f8 2020-04-28T12:41:53.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.536+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11.695 2020-04-28T12:41:53.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.542+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:53.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.542+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:53.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:53.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:53.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:53.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.543+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.544+0000 7f2143156180 10 manifest: total_size = 527 2020-04-28T12:41:53.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.544+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.315 2020-04-28T12:41:53.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.544+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55bc5dde62f8 s->prefetch_data=0 2020-04-28T12:41:53.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.544+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dde62f8 2020-04-28T12:41:53.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.544+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11.1557 2020-04-28T12:41:53.550 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.547+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:53.550 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.547+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.551 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.547+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.551 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.547+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.551 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.547+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.551 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.547+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:53.552 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.547+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:53.552 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:53.552 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:41:53.553 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.553 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:53.553 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:53.553 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:53.553 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:53.553 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.2[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:53.553 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.548+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:53.567 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.564+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114068b50 msgr2=0x7f211407dfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.584 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.574+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.590 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.587+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114065c90 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.626 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.623+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.658 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.654+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.839 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.835+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:53.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.835+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:53.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.836+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:53.840 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.836+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:53.851 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.847+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114065c90 msgr2=0x7f2114068150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.868 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.865+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.905 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.901+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114065c90 msgr2=0x7f21140678d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:53.915 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.911+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f211406de70 msgr2=0x7f2114075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:53.952 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.948+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f2114065c90 msgr2=0x7f21140678d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:53.966 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.962+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:53.966 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.962+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:53.967 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2020-04-28T12:41:53.967 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:41:53.967 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:53.968 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:53.968 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:53.968 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2020-04-28T12:41:53.968 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:41:53.968 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.963+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94267513983664 notifier 4906 bl.length()=181 2020-04-28T12:41:53.969 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.965+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.11 from cache 2020-04-28T12:41:53.969 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.965+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2020-04-28T12:41:53.969 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.965+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94267513990944 notifier 4906 bl.length()=239 2020-04-28T12:41:53.993 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:53.989+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f21140674f0 msgr2=0x7f2114081210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:54.007 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.003+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f211407d120 msgr2=0x7f211405ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:54.368 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55bc5d974290 s->prefetch_data=0 2020-04-28T12:41:54.369 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:41:54.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2020-04-28T12:41:54.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:54.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:54.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:54.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:41:54.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:54.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:41:54.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2020-04-28T12:41:54.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:54.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187cf0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:54.371 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.365+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 : miss 2020-04-28T12:41:54.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 info.flags=0x16 2020-04-28T12:41:54.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 to cache LRU end 2020-04-28T12:41:54.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:54.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:54.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:54.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 20 Read xattr: user.rgw.acl 2020-04-28T12:41:54.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 20 Read xattr: user.rgw.idtag 2020-04-28T12:41:54.373 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:41:54.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.366+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:54.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.367+0000 7f2143156180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:41:54.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.367+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 info.flags=0x13 2020-04-28T12:41:54.386 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.367+0000 7f2143156180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 to cache LRU end 2020-04-28T12:41:54.386 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.367+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:54.386 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.367+0000 7f2143156180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:41:54.386 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.367+0000 7f2143156180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 2020-04-28T12:41:54.387 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.382+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114072b80 msgr2=0x7f211406b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:54.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.483+0000 7f2143156180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12]) start_after [] num_entries 1100 2020-04-28T12:41:54.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.542+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:41:54.668 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.664+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:41:54.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:54.842+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:41:55.028 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.024+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f2114072b80 msgr2=0x7f211406b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:55.127 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.124+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6802/23194,v1:172.21.15.197:6803/23194] conn(0x7f2114072b80 msgr2=0x7f211406b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:55.298 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.295+0000 7f2143156180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:41:55.319 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.315+0000 7f2101fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:55.530 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.526+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55bc5dcebe88 s->prefetch_data=0 2020-04-28T12:41:55.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.527+0000 7f2143156180 10 manifest: total_size = 1048576 2020-04-28T12:41:55.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.527+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.320 2020-04-28T12:41:55.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.527+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55bc5dcebe88 s->prefetch_data=0 2020-04-28T12:41:55.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.527+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcebe88 2020-04-28T12:41:55.531 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.527+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12.111 2020-04-28T12:41:55.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.530+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:41:55.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.530+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.534 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:41:55.535 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:55.536 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:55.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:55.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.531+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55bc5dcebe88 s->prefetch_data=0 2020-04-28T12:41:55.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.532+0000 7f2143156180 10 manifest: total_size = 49187 2020-04-28T12:41:55.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.532+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.319 2020-04-28T12:41:55.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.532+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55bc5dcebe88 s->prefetch_data=0 2020-04-28T12:41:55.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.532+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcebe88 2020-04-28T12:41:55.537 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.532+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12.349 2020-04-28T12:41:55.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.535+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:55.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.535+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.535+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.535+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.539 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.535+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.535+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:55.540 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.535+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:55.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:55.541 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:55.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55bc5dcebe88 s->prefetch_data=0 2020-04-28T12:41:55.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 10 manifest: total_size = 4134 2020-04-28T12:41:55.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.321 2020-04-28T12:41:55.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55bc5dcebe88 s->prefetch_data=0 2020-04-28T12:41:55.542 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcebe88 2020-04-28T12:41:55.543 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.536+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12.695 2020-04-28T12:41:55.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.539+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:55.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.539+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.544 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:55.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.545 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:55.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:55.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:55.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.540+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:55.546 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.541+0000 7f2143156180 10 manifest: total_size = 4134 2020-04-28T12:41:55.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.541+0000 7f2143156180 20 get_obj_state: setting s->obj_tag to e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.322 2020-04-28T12:41:55.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.541+0000 7f2143156180 20 get_obj_state: rctx=0x7ffc76187c90 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55bc5dcc74d8 s->prefetch_data=0 2020-04-28T12:41:55.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.541+0000 7f2143156180 20 prepare_atomic_modification: state is not atomic. state=0x55bc5dcc74d8 2020-04-28T12:41:55.547 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.541+0000 7f2143156180 20 bucket index object: default.rgw.buckets.index:.dir.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12.1557 2020-04-28T12:41:55.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.543+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:55.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.543+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.548 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:41:55.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 20 rados->read ofs=0 len=0 2020-04-28T12:41:55.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:41:55.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:41:55.549 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.550 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 10 chain_cache_entry: cache_locator= 2020-04-28T12:41:55.550 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:41:55.550 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:41:55.550 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:41:55.551 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.544+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.3[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:41:55.551 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.545+0000 7f2143156180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:41:55.571 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.567+0000 7f213114a700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6818/23454,v1:172.21.15.197:6819/23454] conn(0x7f21140664d0 msgr2=0x7f211405f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:55.576 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.573+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114065c90 msgr2=0x7f21140678d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:55.664 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.660+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6824/23472,v1:172.21.15.66:6825/23472] conn(0x7f2114067d70 msgr2=0x7f2114069800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:55.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.668+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:41:55.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.668+0000 7f2143156180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:41:55.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.668+0000 7f2143156180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:41:55.672 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.668+0000 7f2143156180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12])"; objs.size()=0; is_truncated=0 2020-04-28T12:41:55.691 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.687+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6800/23098,v1:172.21.15.66:6801/23098] conn(0x7f21140658b0 msgr2=0x7f211406aea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:55.750 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.746+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114077b20 msgr2=0x7f21140668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:55.772 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.768+0000 7f213194b700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.197:6810/23338,v1:172.21.15.197:6811/23338] conn(0x7f2114065c90 msgr2=0x7f21140678d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:41:55.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.785+0000 7f2143156180 20 get_system_obj_state: rctx=0x7ffc76187488 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55bc5d9b0040 s->prefetch_data=0 2020-04-28T12:41:55.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.785+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:41:55.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f2143156180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2020-04-28T12:41:55.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f2143156180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:41:55.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f2143156180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:41:55.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f2143156180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:41:55.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f2143156180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2020-04-28T12:41:55.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f2143156180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2020-04-28T12:41:55.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:41:55.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.786+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94267513983664 notifier 4906 bl.length()=181 2020-04-28T12:41:55.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.788+0000 7f2143156180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.12 from cache 2020-04-28T12:41:55.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.788+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2020-04-28T12:41:55.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.788+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94267513990944 notifier 4906 bl.length()=239 2020-04-28T12:41:55.958 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:55.954+0000 7f2130949700 0 -- 172.21.15.197:0/2768041559 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x7f2114077b20 msgr2=0x7f21140668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:41:56.200 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.196+0000 7f2143156180 10 removing key index: CSWNFZXWAAGDRFVJFXNK 2020-04-28T12:41:56.200 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.196+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2020-04-28T12:41:56.200 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.197+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94267513986144 notifier 4906 bl.length()=170 2020-04-28T12:41:56.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.199+0000 7f2143156180 10 removing email index: ragweed.client.0+test@test.test 2020-04-28T12:41:56.202 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.199+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2020-04-28T12:41:56.203 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.199+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879304 cookie 94267513938384 notifier 4906 bl.length()=182 2020-04-28T12:41:56.204 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.201+0000 7f2143156180 10 removing user buckets index 2020-04-28T12:41:56.205 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.201+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2020-04-28T12:41:56.205 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.201+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94267513986144 notifier 4906 bl.length()=173 2020-04-28T12:41:56.206 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.203+0000 7f2143156180 10 removing user index: ragweed.client.0 2020-04-28T12:41:56.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.203+0000 7f2143156180 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2020-04-28T12:41:56.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.203+0000 7f2143156180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2020-04-28T12:41:56.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.203+0000 7f21127fc700 10 RGWWatcher::handle_notify() notify_id 541165879303 cookie 94267513984832 notifier 4906 bl.length()=165 2020-04-28T12:41:56.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.206+0000 7f2101fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:41:56.211 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.207+0000 7f2143156180 20 remove_watcher() i=0 2020-04-28T12:41:56.211 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.207+0000 7f2143156180 2 removed watcher, disabling cache 2020-04-28T12:41:56.212 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.208+0000 7f2143156180 20 remove_watcher() i=1 2020-04-28T12:41:56.213 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.209+0000 7f2143156180 20 remove_watcher() i=2 2020-04-28T12:41:56.214 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.211+0000 7f2143156180 20 remove_watcher() i=3 2020-04-28T12:41:56.216 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.212+0000 7f2143156180 20 remove_watcher() i=4 2020-04-28T12:41:56.217 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.213+0000 7f2143156180 20 remove_watcher() i=5 2020-04-28T12:41:56.218 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.214+0000 7f2143156180 20 remove_watcher() i=6 2020-04-28T12:41:56.219 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:41:56.216+0000 7f2143156180 20 remove_watcher() i=7 2020-04-28T12:41:56.225 INFO:tasks.ragweed:Removing ragweed... 2020-04-28T12:41:56.225 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:56.280 INFO:teuthology.orchestra.run.smithi197:> rm -rf /home/ubuntu/cephtest/ragweed 2020-04-28T12:41:56.370 INFO:teuthology.run_tasks:Running task s3tests-java... 2020-04-28T12:41:56.386 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2020-04-28T12:41:56.386 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2020-04-28T12:41:56.387 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2020-04-28T12:41:56.387 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:41:56.400 INFO:teuthology.orchestra.run.smithi197:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2020-04-28T12:41:56.455 INFO:teuthology.orchestra.run.smithi197.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2020-04-28T12:42:03.828 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2020-04-28T12:42:03.828 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:03.885 INFO:teuthology.orchestra.run.smithi197:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2020-04-28T12:42:05.144 INFO:teuthology.orchestra.run.smithi197.stdout: Gradle will be installed under /opt/gradle 2020-04-28T12:42:05.483 INFO:teuthology.orchestra.run.smithi197.stderr:--2020-04-28 12:42:05-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:42:05.517 INFO:teuthology.orchestra.run.smithi197.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.190.9, 104.18.191.9, 2606:4700::6812:be09, ... 2020-04-28T12:42:05.535 INFO:teuthology.orchestra.run.smithi197.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.190.9|:443... connected. 2020-04-28T12:42:05.606 INFO:teuthology.orchestra.run.smithi197.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2020-04-28T12:42:05.606 INFO:teuthology.orchestra.run.smithi197.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip [following] 2020-04-28T12:42:05.606 INFO:teuthology.orchestra.run.smithi197.stderr:--2020-04-28 12:42:05-- https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:42:05.607 INFO:teuthology.orchestra.run.smithi197.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:a014, ... 2020-04-28T12:42:05.625 INFO:teuthology.orchestra.run.smithi197.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2020-04-28T12:42:05.701 INFO:teuthology.orchestra.run.smithi197.stderr:HTTP request sent, awaiting response... 200 OK 2020-04-28T12:42:05.886 INFO:teuthology.orchestra.run.smithi197.stderr:Length: 95129672 (91M) [application/zip] 2020-04-28T12:42:05.886 INFO:teuthology.orchestra.run.smithi197.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2020-04-28T12:42:05.886 INFO:teuthology.orchestra.run.smithi197.stderr: 2020-04-28T12:42:05.892 INFO:teuthology.orchestra.run.smithi197.stderr: 0K .......... .......... .......... .......... .......... 0% 62.7M 1s 2020-04-28T12:42:05.892 INFO:teuthology.orchestra.run.smithi197.stderr: 50K .......... .......... .......... .......... .......... 0% 107M 1s 2020-04-28T12:42:05.892 INFO:teuthology.orchestra.run.smithi197.stderr: 100K .......... .......... .......... .......... .......... 0% 101M 1s 2020-04-28T12:42:05.892 INFO:teuthology.orchestra.run.smithi197.stderr: 150K .......... .......... .......... .......... .......... 0% 109M 1s 2020-04-28T12:42:05.904 INFO:teuthology.orchestra.run.smithi197.stderr: 200K .......... .......... .......... .......... .......... 0% 2.85M 7s 2020-04-28T12:42:05.906 INFO:teuthology.orchestra.run.smithi197.stderr: 250K .......... .......... .......... .......... .......... 0% 39.4M 6s 2020-04-28T12:42:05.906 INFO:teuthology.orchestra.run.smithi197.stderr: 300K .......... .......... .......... .......... .......... 0% 55.7M 6s 2020-04-28T12:42:05.922 INFO:teuthology.orchestra.run.smithi197.stderr: 350K .......... .......... .......... .......... .......... 0% 3.11M 9s 2020-04-28T12:42:05.924 INFO:teuthology.orchestra.run.smithi197.stderr: 400K .......... .......... .......... .......... .......... 0% 64.3M 8s 2020-04-28T12:42:05.924 INFO:teuthology.orchestra.run.smithi197.stderr: 450K .......... .......... .......... .......... .......... 0% 66.1M 7s 2020-04-28T12:42:05.926 INFO:teuthology.orchestra.run.smithi197.stderr: 500K .......... .......... .......... .......... .......... 0% 52.0M 7s 2020-04-28T12:42:05.926 INFO:teuthology.orchestra.run.smithi197.stderr: 550K .......... .......... .......... .......... .......... 0% 51.1M 6s 2020-04-28T12:42:05.926 INFO:teuthology.orchestra.run.smithi197.stderr: 600K .......... .......... .......... .......... .......... 0% 65.2M 6s 2020-04-28T12:42:05.928 INFO:teuthology.orchestra.run.smithi197.stderr: 650K .......... .......... .......... .......... .......... 0% 52.5M 6s 2020-04-28T12:42:05.928 INFO:teuthology.orchestra.run.smithi197.stderr: 700K .......... .......... .......... .......... .......... 0% 53.1M 5s 2020-04-28T12:42:05.941 INFO:teuthology.orchestra.run.smithi197.stderr: 750K .......... .......... .......... .......... .......... 0% 4.12M 6s 2020-04-28T12:42:05.941 INFO:teuthology.orchestra.run.smithi197.stderr: 800K .......... .......... .......... .......... .......... 0% 59.5M 6s 2020-04-28T12:42:05.951 INFO:teuthology.orchestra.run.smithi197.stderr: 850K .......... .......... .......... .......... .......... 0% 60.6M 6s 2020-04-28T12:42:05.951 INFO:teuthology.orchestra.run.smithi197.stderr: 900K .......... .......... .......... .......... .......... 1% 48.5M 6s 2020-04-28T12:42:05.951 INFO:teuthology.orchestra.run.smithi197.stderr: 950K .......... .......... .......... .......... .......... 1% 103M 5s 2020-04-28T12:42:05.951 INFO:teuthology.orchestra.run.smithi197.stderr: 1000K .......... .......... .......... .......... .......... 1% 52.1M 5s 2020-04-28T12:42:05.951 INFO:teuthology.orchestra.run.smithi197.stderr: 1050K .......... .......... .......... .......... .......... 1% 58.4M 5s 2020-04-28T12:42:05.952 INFO:teuthology.orchestra.run.smithi197.stderr: 1100K .......... .......... .......... .......... .......... 1% 49.6M 5s 2020-04-28T12:42:05.952 INFO:teuthology.orchestra.run.smithi197.stderr: 1150K .......... .......... .......... .......... .......... 1% 45.2M 5s 2020-04-28T12:42:05.952 INFO:teuthology.orchestra.run.smithi197.stderr: 1200K .......... .......... .......... .......... .......... 1% 59.8M 5s 2020-04-28T12:42:05.952 INFO:teuthology.orchestra.run.smithi197.stderr: 1250K .......... .......... .......... .......... .......... 1% 65.8M 4s 2020-04-28T12:42:05.952 INFO:teuthology.orchestra.run.smithi197.stderr: 1300K .......... .......... .......... .......... .......... 1% 52.0M 4s 2020-04-28T12:42:05.952 INFO:teuthology.orchestra.run.smithi197.stderr: 1350K .......... .......... .......... .......... .......... 1% 50.1M 4s 2020-04-28T12:42:05.952 INFO:teuthology.orchestra.run.smithi197.stderr: 1400K .......... .......... .......... .......... .......... 1% 67.8M 4s 2020-04-28T12:42:05.954 INFO:teuthology.orchestra.run.smithi197.stderr: 1450K .......... .......... .......... .......... .......... 1% 52.9M 4s 2020-04-28T12:42:05.958 INFO:teuthology.orchestra.run.smithi197.stderr: 1500K .......... .......... .......... .......... .......... 1% 52.2M 4s 2020-04-28T12:42:05.958 INFO:teuthology.orchestra.run.smithi197.stderr: 1550K .......... .......... .......... .......... .......... 1% 11.3M 4s 2020-04-28T12:42:05.966 INFO:teuthology.orchestra.run.smithi197.stderr: 1600K .......... .......... .......... .......... .......... 1% 61.0M 4s 2020-04-28T12:42:05.966 INFO:teuthology.orchestra.run.smithi197.stderr: 1650K .......... .......... .......... .......... .......... 1% 66.7M 4s 2020-04-28T12:42:05.966 INFO:teuthology.orchestra.run.smithi197.stderr: 1700K .......... .......... .......... .......... .......... 1% 67.2M 4s 2020-04-28T12:42:05.966 INFO:teuthology.orchestra.run.smithi197.stderr: 1750K .......... .......... .......... .......... .......... 1% 72.3M 4s 2020-04-28T12:42:05.966 INFO:teuthology.orchestra.run.smithi197.stderr: 1800K .......... .......... .......... .......... .......... 1% 72.3M 4s 2020-04-28T12:42:05.966 INFO:teuthology.orchestra.run.smithi197.stderr: 1850K .......... .......... .......... .......... .......... 2% 67.8M 4s 2020-04-28T12:42:05.967 INFO:teuthology.orchestra.run.smithi197.stderr: 1900K .......... .......... .......... .......... .......... 2% 77.1M 4s 2020-04-28T12:42:05.967 INFO:teuthology.orchestra.run.smithi197.stderr: 1950K .......... .......... .......... .......... .......... 2% 55.4M 4s 2020-04-28T12:42:05.967 INFO:teuthology.orchestra.run.smithi197.stderr: 2000K .......... .......... .......... .......... .......... 2% 75.1M 3s 2020-04-28T12:42:05.967 INFO:teuthology.orchestra.run.smithi197.stderr: 2050K .......... .......... .......... .......... .......... 2% 78.7M 3s 2020-04-28T12:42:05.967 INFO:teuthology.orchestra.run.smithi197.stderr: 2100K .......... .......... .......... .......... .......... 2% 72.6M 3s 2020-04-28T12:42:05.967 INFO:teuthology.orchestra.run.smithi197.stderr: 2150K .......... .......... .......... .......... .......... 2% 69.8M 3s 2020-04-28T12:42:07.191 INFO:teuthology.orchestra.run.smithi197.stderr: 2200K .......... .......... .......... .......... .......... 2% 70.2M 3s 2020-04-28T12:42:07.192 INFO:teuthology.orchestra.run.smithi197.stderr: 2250K .......... .......... .......... .......... .......... 2% 83.0M 3s 2020-04-28T12:42:07.192 INFO:teuthology.orchestra.run.smithi197.stderr: 2300K .......... .......... .......... .......... .......... 2% 77.4M 3s 2020-04-28T12:42:07.192 INFO:teuthology.orchestra.run.smithi197.stderr: 2350K .......... .......... .......... .......... .......... 2% 61.0M 3s 2020-04-28T12:42:07.192 INFO:teuthology.orchestra.run.smithi197.stderr: 2400K .......... .......... .......... .......... .......... 2% 91.8M 3s 2020-04-28T12:42:07.192 INFO:teuthology.orchestra.run.smithi197.stderr: 2450K .......... .......... .......... .......... .......... 2% 80.9M 3s 2020-04-28T12:42:07.192 INFO:teuthology.orchestra.run.smithi197.stderr: 2500K .......... .......... .......... .......... .......... 2% 86.5M 3s 2020-04-28T12:42:07.193 INFO:teuthology.orchestra.run.smithi197.stderr: 2550K .......... .......... .......... .......... .......... 2% 92.9M 3s 2020-04-28T12:42:07.193 INFO:teuthology.orchestra.run.smithi197.stderr: 2600K .......... .......... .......... .......... .......... 2% 90.2M 3s 2020-04-28T12:42:07.193 INFO:teuthology.orchestra.run.smithi197.stderr: 2650K .......... .......... .......... .......... .......... 2% 91.1M 3s 2020-04-28T12:42:07.193 INFO:teuthology.orchestra.run.smithi197.stderr: 2700K .......... .......... .......... .......... .......... 2% 95.4M 3s 2020-04-28T12:42:07.193 INFO:teuthology.orchestra.run.smithi197.stderr: 2750K .......... .......... .......... .......... .......... 3% 71.9M 3s 2020-04-28T12:42:07.193 INFO:teuthology.orchestra.run.smithi197.stderr: 2800K .......... .......... .......... .......... .......... 3% 93.3M 3s 2020-04-28T12:42:07.193 INFO:teuthology.orchestra.run.smithi197.stderr: 2850K .......... .......... .......... .......... .......... 3% 97.4M 3s 2020-04-28T12:42:07.194 INFO:teuthology.orchestra.run.smithi197.stderr: 2900K .......... .......... .......... .......... .......... 3% 84.1M 3s 2020-04-28T12:42:07.194 INFO:teuthology.orchestra.run.smithi197.stderr: 2950K .......... .......... .......... .......... .......... 3% 96.0M 3s 2020-04-28T12:42:07.194 INFO:teuthology.orchestra.run.smithi197.stderr: 3000K .......... .......... .......... .......... .......... 3% 105M 3s 2020-04-28T12:42:07.194 INFO:teuthology.orchestra.run.smithi197.stderr: 3050K .......... .......... .......... .......... .......... 3% 120M 3s 2020-04-28T12:42:07.194 INFO:teuthology.orchestra.run.smithi197.stderr: 3100K .......... .......... .......... .......... .......... 3% 112M 3s 2020-04-28T12:42:07.195 INFO:teuthology.orchestra.run.smithi197.stderr: 3150K .......... .......... .......... .......... .......... 3% 93.2M 3s 2020-04-28T12:42:07.195 INFO:teuthology.orchestra.run.smithi197.stderr: 3200K .......... .......... .......... .......... .......... 3% 117M 3s 2020-04-28T12:42:07.195 INFO:teuthology.orchestra.run.smithi197.stderr: 3250K .......... .......... .......... .......... .......... 3% 113M 3s 2020-04-28T12:42:07.195 INFO:teuthology.orchestra.run.smithi197.stderr: 3300K .......... .......... .......... .......... .......... 3% 115M 2s 2020-04-28T12:42:07.195 INFO:teuthology.orchestra.run.smithi197.stderr: 3350K .......... .......... .......... .......... .......... 3% 112M 2s 2020-04-28T12:42:07.195 INFO:teuthology.orchestra.run.smithi197.stderr: 3400K .......... .......... .......... .......... .......... 3% 110M 2s 2020-04-28T12:42:07.195 INFO:teuthology.orchestra.run.smithi197.stderr: 3450K .......... .......... .......... .......... .......... 3% 113M 2s 2020-04-28T12:42:07.196 INFO:teuthology.orchestra.run.smithi197.stderr: 3500K .......... .......... .......... .......... .......... 3% 121M 2s 2020-04-28T12:42:07.196 INFO:teuthology.orchestra.run.smithi197.stderr: 3550K .......... .......... .......... .......... .......... 3% 89.7M 2s 2020-04-28T12:42:07.196 INFO:teuthology.orchestra.run.smithi197.stderr: 3600K .......... .......... .......... .......... .......... 3% 115M 2s 2020-04-28T12:42:07.196 INFO:teuthology.orchestra.run.smithi197.stderr: 3650K .......... .......... .......... .......... .......... 3% 118M 2s 2020-04-28T12:42:07.196 INFO:teuthology.orchestra.run.smithi197.stderr: 3700K .......... .......... .......... .......... .......... 4% 107M 2s 2020-04-28T12:42:07.196 INFO:teuthology.orchestra.run.smithi197.stderr: 3750K .......... .......... .......... .......... .......... 4% 115M 2s 2020-04-28T12:42:07.197 INFO:teuthology.orchestra.run.smithi197.stderr: 3800K .......... .......... .......... .......... .......... 4% 120M 2s 2020-04-28T12:42:07.197 INFO:teuthology.orchestra.run.smithi197.stderr: 3850K .......... .......... .......... .......... .......... 4% 115M 2s 2020-04-28T12:42:07.197 INFO:teuthology.orchestra.run.smithi197.stderr: 3900K .......... .......... .......... .......... .......... 4% 113M 2s 2020-04-28T12:42:07.197 INFO:teuthology.orchestra.run.smithi197.stderr: 3950K .......... .......... .......... .......... .......... 4% 93.0M 2s 2020-04-28T12:42:07.197 INFO:teuthology.orchestra.run.smithi197.stderr: 4000K .......... .......... .......... .......... .......... 4% 82.4M 2s 2020-04-28T12:42:07.197 INFO:teuthology.orchestra.run.smithi197.stderr: 4050K .......... .......... .......... .......... .......... 4% 147M 2s 2020-04-28T12:42:07.197 INFO:teuthology.orchestra.run.smithi197.stderr: 4100K .......... .......... .......... .......... .......... 4% 132M 2s 2020-04-28T12:42:07.198 INFO:teuthology.orchestra.run.smithi197.stderr: 4150K .......... .......... .......... .......... .......... 4% 115M 2s 2020-04-28T12:42:07.198 INFO:teuthology.orchestra.run.smithi197.stderr: 4200K .......... .......... .......... .......... .......... 4% 124M 2s 2020-04-28T12:42:07.198 INFO:teuthology.orchestra.run.smithi197.stderr: 4250K .......... .......... .......... .......... .......... 4% 112M 2s 2020-04-28T12:42:07.198 INFO:teuthology.orchestra.run.smithi197.stderr: 4300K .......... .......... .......... .......... .......... 4% 119M 2s 2020-04-28T12:42:07.198 INFO:teuthology.orchestra.run.smithi197.stderr: 4350K .......... .......... .......... .......... .......... 4% 91.5M 2s 2020-04-28T12:42:07.198 INFO:teuthology.orchestra.run.smithi197.stderr: 4400K .......... .......... .......... .......... .......... 4% 114M 2s 2020-04-28T12:42:07.199 INFO:teuthology.orchestra.run.smithi197.stderr: 4450K .......... .......... .......... .......... .......... 4% 120M 2s 2020-04-28T12:42:07.199 INFO:teuthology.orchestra.run.smithi197.stderr: 4500K .......... .......... .......... .......... .......... 4% 119M 2s 2020-04-28T12:42:07.199 INFO:teuthology.orchestra.run.smithi197.stderr: 4550K .......... .......... .......... .......... .......... 4% 109M 2s 2020-04-28T12:42:07.199 INFO:teuthology.orchestra.run.smithi197.stderr: 4600K .......... .......... .......... .......... .......... 5% 113M 2s 2020-04-28T12:42:07.199 INFO:teuthology.orchestra.run.smithi197.stderr: 4650K .......... .......... .......... .......... .......... 5% 119M 2s 2020-04-28T12:42:07.199 INFO:teuthology.orchestra.run.smithi197.stderr: 4700K .......... .......... .......... .......... .......... 5% 117M 2s 2020-04-28T12:42:07.200 INFO:teuthology.orchestra.run.smithi197.stderr: 4750K .......... .......... .......... .......... .......... 5% 92.2M 2s 2020-04-28T12:42:07.200 INFO:teuthology.orchestra.run.smithi197.stderr: 4800K .......... .......... .......... .......... .......... 5% 116M 2s 2020-04-28T12:42:07.200 INFO:teuthology.orchestra.run.smithi197.stderr: 4850K .......... .......... .......... .......... .......... 5% 118M 2s 2020-04-28T12:42:07.200 INFO:teuthology.orchestra.run.smithi197.stderr: 4900K .......... .......... .......... .......... .......... 5% 118M 2s 2020-04-28T12:42:07.200 INFO:teuthology.orchestra.run.smithi197.stderr: 4950K .......... .......... .......... .......... .......... 5% 104M 2s 2020-04-28T12:42:07.201 INFO:teuthology.orchestra.run.smithi197.stderr: 5000K .......... .......... .......... .......... .......... 5% 120M 2s 2020-04-28T12:42:07.201 INFO:teuthology.orchestra.run.smithi197.stderr: 5050K .......... .......... .......... .......... .......... 5% 116M 2s 2020-04-28T12:42:07.201 INFO:teuthology.orchestra.run.smithi197.stderr: 5100K .......... .......... .......... .......... .......... 5% 106M 2s 2020-04-28T12:42:07.201 INFO:teuthology.orchestra.run.smithi197.stderr: 5150K .......... .......... .......... .......... .......... 5% 100M 2s 2020-04-28T12:42:07.201 INFO:teuthology.orchestra.run.smithi197.stderr: 5200K .......... .......... .......... .......... .......... 5% 119M 2s 2020-04-28T12:42:07.202 INFO:teuthology.orchestra.run.smithi197.stderr: 5250K .......... .......... .......... .......... .......... 5% 117M 2s 2020-04-28T12:42:07.202 INFO:teuthology.orchestra.run.smithi197.stderr: 5300K .......... .......... .......... .......... .......... 5% 112M 2s 2020-04-28T12:42:07.202 INFO:teuthology.orchestra.run.smithi197.stderr: 5350K .......... .......... .......... .......... .......... 5% 116M 2s 2020-04-28T12:42:07.202 INFO:teuthology.orchestra.run.smithi197.stderr: 5400K .......... .......... .......... .......... .......... 5% 111M 2s 2020-04-28T12:42:07.202 INFO:teuthology.orchestra.run.smithi197.stderr: 5450K .......... .......... .......... .......... .......... 5% 121M 2s 2020-04-28T12:42:07.202 INFO:teuthology.orchestra.run.smithi197.stderr: 5500K .......... .......... .......... .......... .......... 5% 110M 2s 2020-04-28T12:42:07.203 INFO:teuthology.orchestra.run.smithi197.stderr: 5550K .......... .......... .......... .......... .......... 6% 92.3M 2s 2020-04-28T12:42:07.203 INFO:teuthology.orchestra.run.smithi197.stderr: 5600K .......... .......... .......... .......... .......... 6% 116M 2s 2020-04-28T12:42:07.203 INFO:teuthology.orchestra.run.smithi197.stderr: 5650K .......... .......... .......... .......... .......... 6% 116M 2s 2020-04-28T12:42:07.203 INFO:teuthology.orchestra.run.smithi197.stderr: 5700K .......... .......... .......... .......... .......... 6% 114M 2s 2020-04-28T12:42:07.204 INFO:teuthology.orchestra.run.smithi197.stderr: 5750K .......... .......... .......... .......... .......... 6% 111M 2s 2020-04-28T12:42:07.204 INFO:teuthology.orchestra.run.smithi197.stderr: 5800K .......... .......... .......... .......... .......... 6% 113M 2s 2020-04-28T12:42:07.204 INFO:teuthology.orchestra.run.smithi197.stderr: 5850K .......... .......... .......... .......... .......... 6% 119M 2s 2020-04-28T12:42:07.204 INFO:teuthology.orchestra.run.smithi197.stderr: 5900K .......... .......... .......... .......... .......... 6% 116M 2s 2020-04-28T12:42:07.204 INFO:teuthology.orchestra.run.smithi197.stderr: 5950K .......... .......... .......... .......... .......... 6% 92.0M 2s 2020-04-28T12:42:07.205 INFO:teuthology.orchestra.run.smithi197.stderr: 6000K .......... .......... .......... .......... .......... 6% 111M 2s 2020-04-28T12:42:07.205 INFO:teuthology.orchestra.run.smithi197.stderr: 6050K .......... .......... .......... .......... .......... 6% 119M 2s 2020-04-28T12:42:07.205 INFO:teuthology.orchestra.run.smithi197.stderr: 6100K .......... .......... .......... .......... .......... 6% 119M 2s 2020-04-28T12:42:07.205 INFO:teuthology.orchestra.run.smithi197.stderr: 6150K .......... .......... .......... .......... .......... 6% 109M 2s 2020-04-28T12:42:07.205 INFO:teuthology.orchestra.run.smithi197.stderr: 6200K .......... .......... .......... .......... .......... 6% 114M 2s 2020-04-28T12:42:07.205 INFO:teuthology.orchestra.run.smithi197.stderr: 6250K .......... .......... .......... .......... .......... 6% 117M 2s 2020-04-28T12:42:07.206 INFO:teuthology.orchestra.run.smithi197.stderr: 6300K .......... .......... .......... .......... .......... 6% 112M 2s 2020-04-28T12:42:07.206 INFO:teuthology.orchestra.run.smithi197.stderr: 6350K .......... .......... .......... .......... .......... 6% 82.0M 2s 2020-04-28T12:42:07.206 INFO:teuthology.orchestra.run.smithi197.stderr: 6400K .......... .......... .......... .......... .......... 6% 126M 2s 2020-04-28T12:42:07.206 INFO:teuthology.orchestra.run.smithi197.stderr: 6450K .......... .......... .......... .......... .......... 6% 134M 2s 2020-04-28T12:42:07.206 INFO:teuthology.orchestra.run.smithi197.stderr: 6500K .......... .......... .......... .......... .......... 7% 109M 2s 2020-04-28T12:42:07.206 INFO:teuthology.orchestra.run.smithi197.stderr: 6550K .......... .......... .......... .......... .......... 7% 105M 2s 2020-04-28T12:42:07.207 INFO:teuthology.orchestra.run.smithi197.stderr: 6600K .......... .......... .......... .......... .......... 7% 117M 2s 2020-04-28T12:42:07.207 INFO:teuthology.orchestra.run.smithi197.stderr: 6650K .......... .......... .......... .......... .......... 7% 112M 2s 2020-04-28T12:42:07.207 INFO:teuthology.orchestra.run.smithi197.stderr: 6700K .......... .......... .......... .......... .......... 7% 119M 2s 2020-04-28T12:42:07.207 INFO:teuthology.orchestra.run.smithi197.stderr: 6750K .......... .......... .......... .......... .......... 7% 90.0M 2s 2020-04-28T12:42:07.207 INFO:teuthology.orchestra.run.smithi197.stderr: 6800K .......... .......... .......... .......... .......... 7% 118M 2s 2020-04-28T12:42:07.207 INFO:teuthology.orchestra.run.smithi197.stderr: 6850K .......... .......... .......... .......... .......... 7% 109M 2s 2020-04-28T12:42:07.207 INFO:teuthology.orchestra.run.smithi197.stderr: 6900K .......... .......... .......... .......... .......... 7% 122M 2s 2020-04-28T12:42:07.208 INFO:teuthology.orchestra.run.smithi197.stderr: 6950K .......... .......... .......... .......... .......... 7% 105M 2s 2020-04-28T12:42:07.208 INFO:teuthology.orchestra.run.smithi197.stderr: 7000K .......... .......... .......... .......... .......... 7% 119M 2s 2020-04-28T12:42:07.208 INFO:teuthology.orchestra.run.smithi197.stderr: 7050K .......... .......... .......... .......... .......... 7% 111M 2s 2020-04-28T12:42:07.208 INFO:teuthology.orchestra.run.smithi197.stderr: 7100K .......... .......... .......... .......... .......... 7% 113M 2s 2020-04-28T12:42:07.208 INFO:teuthology.orchestra.run.smithi197.stderr: 7150K .......... .......... .......... .......... .......... 7% 94.0M 2s 2020-04-28T12:42:07.208 INFO:teuthology.orchestra.run.smithi197.stderr: 7200K .......... .......... .......... .......... .......... 7% 122M 2s 2020-04-28T12:42:07.208 INFO:teuthology.orchestra.run.smithi197.stderr: 7250K .......... .......... .......... .......... .......... 7% 111M 1s 2020-04-28T12:42:07.209 INFO:teuthology.orchestra.run.smithi197.stderr: 7300K .......... .......... .......... .......... .......... 7% 120M 1s 2020-04-28T12:42:07.209 INFO:teuthology.orchestra.run.smithi197.stderr: 7350K .......... .......... .......... .......... .......... 7% 109M 1s 2020-04-28T12:42:07.209 INFO:teuthology.orchestra.run.smithi197.stderr: 7400K .......... .......... .......... .......... .......... 8% 119M 1s 2020-04-28T12:42:07.209 INFO:teuthology.orchestra.run.smithi197.stderr: 7450K .......... .......... .......... .......... .......... 8% 110M 1s 2020-04-28T12:42:07.209 INFO:teuthology.orchestra.run.smithi197.stderr: 7500K .......... .......... .......... .......... .......... 8% 115M 1s 2020-04-28T12:42:07.209 INFO:teuthology.orchestra.run.smithi197.stderr: 7550K .......... .......... .......... .......... .......... 8% 90.3M 1s 2020-04-28T12:42:07.209 INFO:teuthology.orchestra.run.smithi197.stderr: 7600K .......... .......... .......... .......... .......... 8% 111M 1s 2020-04-28T12:42:07.210 INFO:teuthology.orchestra.run.smithi197.stderr: 7650K .......... .......... .......... .......... .......... 8% 122M 1s 2020-04-28T12:42:07.210 INFO:teuthology.orchestra.run.smithi197.stderr: 7700K .......... .......... .......... .......... .......... 8% 138M 1s 2020-04-28T12:42:07.210 INFO:teuthology.orchestra.run.smithi197.stderr: 7750K .......... .......... .......... .......... .......... 8% 89.2M 1s 2020-04-28T12:42:07.210 INFO:teuthology.orchestra.run.smithi197.stderr: 7800K .......... .......... .......... .......... .......... 8% 112M 1s 2020-04-28T12:42:07.210 INFO:teuthology.orchestra.run.smithi197.stderr: 7850K .......... .......... .......... .......... .......... 8% 119M 1s 2020-04-28T12:42:07.210 INFO:teuthology.orchestra.run.smithi197.stderr: 7900K .......... .......... .......... .......... .......... 8% 115M 1s 2020-04-28T12:42:07.210 INFO:teuthology.orchestra.run.smithi197.stderr: 7950K .......... .......... .......... .......... .......... 8% 111M 1s 2020-04-28T12:42:07.211 INFO:teuthology.orchestra.run.smithi197.stderr: 8000K .......... .......... .......... .......... .......... 8% 113M 1s 2020-04-28T12:42:07.211 INFO:teuthology.orchestra.run.smithi197.stderr: 8050K .......... .......... .......... .......... .......... 8% 119M 1s 2020-04-28T12:42:07.212 INFO:teuthology.orchestra.run.smithi197.stderr: 8100K .......... .......... .......... .......... .......... 8% 116M 1s 2020-04-28T12:42:07.212 INFO:teuthology.orchestra.run.smithi197.stderr: 8150K .......... .......... .......... .......... .......... 8% 90.6M 1s 2020-04-28T12:42:07.212 INFO:teuthology.orchestra.run.smithi197.stderr: 8200K .......... .......... .......... .......... .......... 8% 106M 1s 2020-04-28T12:42:07.212 INFO:teuthology.orchestra.run.smithi197.stderr: 8250K .......... .......... .......... .......... .......... 8% 118M 1s 2020-04-28T12:42:07.212 INFO:teuthology.orchestra.run.smithi197.stderr: 8300K .......... .......... .......... .......... .......... 8% 109M 1s 2020-04-28T12:42:07.212 INFO:teuthology.orchestra.run.smithi197.stderr: 8350K .......... .......... .......... .......... .......... 9% 98.0M 1s 2020-04-28T12:42:07.213 INFO:teuthology.orchestra.run.smithi197.stderr: 8400K .......... .......... .......... .......... .......... 9% 127M 1s 2020-04-28T12:42:07.213 INFO:teuthology.orchestra.run.smithi197.stderr: 8450K .......... .......... .......... .......... .......... 9% 113M 1s 2020-04-28T12:42:07.213 INFO:teuthology.orchestra.run.smithi197.stderr: 8500K .......... .......... .......... .......... .......... 9% 113M 1s 2020-04-28T12:42:07.213 INFO:teuthology.orchestra.run.smithi197.stderr: 8550K .......... .......... .......... .......... .......... 9% 86.3M 1s 2020-04-28T12:42:07.213 INFO:teuthology.orchestra.run.smithi197.stderr: 8600K .......... .......... .......... .......... .......... 9% 104M 1s 2020-04-28T12:42:07.213 INFO:teuthology.orchestra.run.smithi197.stderr: 8650K .......... .......... .......... .......... .......... 9% 133M 1s 2020-04-28T12:42:07.213 INFO:teuthology.orchestra.run.smithi197.stderr: 8700K .......... .......... .......... .......... .......... 9% 115M 1s 2020-04-28T12:42:07.214 INFO:teuthology.orchestra.run.smithi197.stderr: 8750K .......... .......... .......... .......... .......... 9% 105M 1s 2020-04-28T12:42:07.214 INFO:teuthology.orchestra.run.smithi197.stderr: 8800K .......... .......... .......... .......... .......... 9% 118M 1s 2020-04-28T12:42:07.215 INFO:teuthology.orchestra.run.smithi197.stderr: 8850K .......... .......... .......... .......... .......... 9% 113M 1s 2020-04-28T12:42:07.215 INFO:teuthology.orchestra.run.smithi197.stderr: 8900K .......... .......... .......... .......... .......... 9% 111M 1s 2020-04-28T12:42:07.215 INFO:teuthology.orchestra.run.smithi197.stderr: 8950K .......... .......... .......... .......... .......... 9% 93.4M 1s 2020-04-28T12:42:07.215 INFO:teuthology.orchestra.run.smithi197.stderr: 9000K .......... .......... .......... .......... .......... 9% 115M 1s 2020-04-28T12:42:07.215 INFO:teuthology.orchestra.run.smithi197.stderr: 9050K .......... .......... .......... .......... .......... 9% 112M 1s 2020-04-28T12:42:07.215 INFO:teuthology.orchestra.run.smithi197.stderr: 9100K .......... .......... .......... .......... .......... 9% 117M 1s 2020-04-28T12:42:07.216 INFO:teuthology.orchestra.run.smithi197.stderr: 9150K .......... .......... .......... .......... .......... 9% 117M 1s 2020-04-28T12:42:07.216 INFO:teuthology.orchestra.run.smithi197.stderr: 9200K .......... .......... .......... .......... .......... 9% 112M 1s 2020-04-28T12:42:07.216 INFO:teuthology.orchestra.run.smithi197.stderr: 9250K .......... .......... .......... .......... .......... 10% 118M 1s 2020-04-28T12:42:07.216 INFO:teuthology.orchestra.run.smithi197.stderr: 9300K .......... .......... .......... .......... .......... 10% 116M 1s 2020-04-28T12:42:07.216 INFO:teuthology.orchestra.run.smithi197.stderr: 9350K .......... .......... .......... .......... .......... 10% 88.8M 1s 2020-04-28T12:42:07.216 INFO:teuthology.orchestra.run.smithi197.stderr: 9400K .......... .......... .......... .......... .......... 10% 114M 1s 2020-04-28T12:42:07.217 INFO:teuthology.orchestra.run.smithi197.stderr: 9450K .......... .......... .......... .......... .......... 10% 110M 1s 2020-04-28T12:42:07.217 INFO:teuthology.orchestra.run.smithi197.stderr: 9500K .......... .......... .......... .......... .......... 10% 118M 1s 2020-04-28T12:42:07.217 INFO:teuthology.orchestra.run.smithi197.stderr: 9550K .......... .......... .......... .......... .......... 10% 77.3M 1s 2020-04-28T12:42:07.217 INFO:teuthology.orchestra.run.smithi197.stderr: 9600K .......... .......... .......... .......... .......... 10% 150M 1s 2020-04-28T12:42:07.217 INFO:teuthology.orchestra.run.smithi197.stderr: 9650K .......... .......... .......... .......... .......... 10% 132M 1s 2020-04-28T12:42:07.217 INFO:teuthology.orchestra.run.smithi197.stderr: 9700K .......... .......... .......... .......... .......... 10% 122M 1s 2020-04-28T12:42:07.217 INFO:teuthology.orchestra.run.smithi197.stderr: 9750K .......... .......... .......... .......... .......... 10% 76.5M 1s 2020-04-28T12:42:07.218 INFO:teuthology.orchestra.run.smithi197.stderr: 9800K .......... .......... .......... .......... .......... 10% 137M 1s 2020-04-28T12:42:07.218 INFO:teuthology.orchestra.run.smithi197.stderr: 9850K .......... .......... .......... .......... .......... 10% 81.5M 1s 2020-04-28T12:42:07.218 INFO:teuthology.orchestra.run.smithi197.stderr: 9900K .......... .......... .......... .......... .......... 10% 108M 1s 2020-04-28T12:42:07.218 INFO:teuthology.orchestra.run.smithi197.stderr: 9950K .......... .......... .......... .......... .......... 10% 202M 1s 2020-04-28T12:42:07.218 INFO:teuthology.orchestra.run.smithi197.stderr: 10000K .......... .......... .......... .......... .......... 10% 75.3M 1s 2020-04-28T12:42:07.218 INFO:teuthology.orchestra.run.smithi197.stderr: 10050K .......... .......... .......... .......... .......... 10% 92.3M 1s 2020-04-28T12:42:07.218 INFO:teuthology.orchestra.run.smithi197.stderr: 10100K .......... .......... .......... .......... .......... 10% 221M 1s 2020-04-28T12:42:07.219 INFO:teuthology.orchestra.run.smithi197.stderr: 10150K .......... .......... .......... .......... .......... 10% 93.7M 1s 2020-04-28T12:42:07.219 INFO:teuthology.orchestra.run.smithi197.stderr: 10200K .......... .......... .......... .......... .......... 11% 158M 1s 2020-04-28T12:42:07.219 INFO:teuthology.orchestra.run.smithi197.stderr: 10250K .......... .......... .......... .......... .......... 11% 112M 1s 2020-04-28T12:42:07.219 INFO:teuthology.orchestra.run.smithi197.stderr: 10300K .......... .......... .......... .......... .......... 11% 103M 1s 2020-04-28T12:42:07.220 INFO:teuthology.orchestra.run.smithi197.stderr: 10350K .......... .......... .......... .......... .......... 11% 124M 1s 2020-04-28T12:42:07.220 INFO:teuthology.orchestra.run.smithi197.stderr: 10400K .......... .......... .......... .......... .......... 11% 106M 1s 2020-04-28T12:42:07.220 INFO:teuthology.orchestra.run.smithi197.stderr: 10450K .......... .......... .......... .......... .......... 11% 115M 1s 2020-04-28T12:42:07.220 INFO:teuthology.orchestra.run.smithi197.stderr: 10500K .......... .......... .......... .......... .......... 11% 103M 1s 2020-04-28T12:42:07.220 INFO:teuthology.orchestra.run.smithi197.stderr: 10550K .......... .......... .......... .......... .......... 11% 97.8M 1s 2020-04-28T12:42:07.220 INFO:teuthology.orchestra.run.smithi197.stderr: 10600K .......... .......... .......... .......... .......... 11% 119M 1s 2020-04-28T12:42:07.220 INFO:teuthology.orchestra.run.smithi197.stderr: 10650K .......... .......... .......... .......... .......... 11% 109M 1s 2020-04-28T12:42:07.221 INFO:teuthology.orchestra.run.smithi197.stderr: 10700K .......... .......... .......... .......... .......... 11% 125M 1s 2020-04-28T12:42:07.221 INFO:teuthology.orchestra.run.smithi197.stderr: 10750K .......... .......... .......... .......... .......... 11% 107M 1s 2020-04-28T12:42:07.221 INFO:teuthology.orchestra.run.smithi197.stderr: 10800K .......... .......... .......... .......... .......... 11% 118M 1s 2020-04-28T12:42:07.221 INFO:teuthology.orchestra.run.smithi197.stderr: 10850K .......... .......... .......... .......... .......... 11% 110M 1s 2020-04-28T12:42:07.221 INFO:teuthology.orchestra.run.smithi197.stderr: 10900K .......... .......... .......... .......... .......... 11% 110M 1s 2020-04-28T12:42:07.221 INFO:teuthology.orchestra.run.smithi197.stderr: 10950K .......... .......... .......... .......... .......... 11% 91.3M 1s 2020-04-28T12:42:07.221 INFO:teuthology.orchestra.run.smithi197.stderr: 11000K .......... .......... .......... .......... .......... 11% 107M 1s 2020-04-28T12:42:07.222 INFO:teuthology.orchestra.run.smithi197.stderr: 11050K .......... .......... .......... .......... .......... 11% 108M 1s 2020-04-28T12:42:07.222 INFO:teuthology.orchestra.run.smithi197.stderr: 11100K .......... .......... .......... .......... .......... 12% 127M 1s 2020-04-28T12:42:07.222 INFO:teuthology.orchestra.run.smithi197.stderr: 11150K .......... .......... .......... .......... .......... 12% 110M 1s 2020-04-28T12:42:07.222 INFO:teuthology.orchestra.run.smithi197.stderr: 11200K .......... .......... .......... .......... .......... 12% 114M 1s 2020-04-28T12:42:07.222 INFO:teuthology.orchestra.run.smithi197.stderr: 11250K .......... .......... .......... .......... .......... 12% 118M 1s 2020-04-28T12:42:07.222 INFO:teuthology.orchestra.run.smithi197.stderr: 11300K .......... .......... .......... .......... .......... 12% 116M 1s 2020-04-28T12:42:07.223 INFO:teuthology.orchestra.run.smithi197.stderr: 11350K .......... .......... .......... .......... .......... 12% 87.0M 1s 2020-04-28T12:42:07.223 INFO:teuthology.orchestra.run.smithi197.stderr: 11400K .......... .......... .......... .......... .......... 12% 112M 1s 2020-04-28T12:42:07.223 INFO:teuthology.orchestra.run.smithi197.stderr: 11450K .......... .......... .......... .......... .......... 12% 117M 1s 2020-04-28T12:42:07.223 INFO:teuthology.orchestra.run.smithi197.stderr: 11500K .......... .......... .......... .......... .......... 12% 118M 1s 2020-04-28T12:42:07.223 INFO:teuthology.orchestra.run.smithi197.stderr: 11550K .......... .......... .......... .......... .......... 12% 110M 1s 2020-04-28T12:42:07.223 INFO:teuthology.orchestra.run.smithi197.stderr: 11600K .......... .......... .......... .......... .......... 12% 111M 1s 2020-04-28T12:42:07.223 INFO:teuthology.orchestra.run.smithi197.stderr: 11650K .......... .......... .......... .......... .......... 12% 126M 1s 2020-04-28T12:42:07.224 INFO:teuthology.orchestra.run.smithi197.stderr: 11700K .......... .......... .......... .......... .......... 12% 111M 1s 2020-04-28T12:42:07.224 INFO:teuthology.orchestra.run.smithi197.stderr: 11750K .......... .......... .......... .......... .......... 12% 92.7M 1s 2020-04-28T12:42:07.224 INFO:teuthology.orchestra.run.smithi197.stderr: 11800K .......... .......... .......... .......... .......... 12% 112M 1s 2020-04-28T12:42:07.224 INFO:teuthology.orchestra.run.smithi197.stderr: 11850K .......... .......... .......... .......... .......... 12% 115M 1s 2020-04-28T12:42:07.224 INFO:teuthology.orchestra.run.smithi197.stderr: 11900K .......... .......... .......... .......... .......... 12% 115M 1s 2020-04-28T12:42:07.224 INFO:teuthology.orchestra.run.smithi197.stderr: 11950K .......... .......... .......... .......... .......... 12% 108M 1s 2020-04-28T12:42:07.224 INFO:teuthology.orchestra.run.smithi197.stderr: 12000K .......... .......... .......... .......... .......... 12% 114M 1s 2020-04-28T12:42:07.225 INFO:teuthology.orchestra.run.smithi197.stderr: 12050K .......... .......... .......... .......... .......... 13% 113M 1s 2020-04-28T12:42:07.225 INFO:teuthology.orchestra.run.smithi197.stderr: 12100K .......... .......... .......... .......... .......... 13% 111M 1s 2020-04-28T12:42:07.225 INFO:teuthology.orchestra.run.smithi197.stderr: 12150K .......... .......... .......... .......... .......... 13% 91.2M 1s 2020-04-28T12:42:07.225 INFO:teuthology.orchestra.run.smithi197.stderr: 12200K .......... .......... .......... .......... .......... 13% 116M 1s 2020-04-28T12:42:07.225 INFO:teuthology.orchestra.run.smithi197.stderr: 12250K .......... .......... .......... .......... .......... 13% 112M 1s 2020-04-28T12:42:07.225 INFO:teuthology.orchestra.run.smithi197.stderr: 12300K .......... .......... .......... .......... .......... 13% 112M 1s 2020-04-28T12:42:07.226 INFO:teuthology.orchestra.run.smithi197.stderr: 12350K .......... .......... .......... .......... .......... 13% 108M 1s 2020-04-28T12:42:07.226 INFO:teuthology.orchestra.run.smithi197.stderr: 12400K .......... .......... .......... .......... .......... 13% 118M 1s 2020-04-28T12:42:07.226 INFO:teuthology.orchestra.run.smithi197.stderr: 12450K .......... .......... .......... .......... .......... 13% 107M 1s 2020-04-28T12:42:07.226 INFO:teuthology.orchestra.run.smithi197.stderr: 12500K .......... .......... .......... .......... .......... 13% 128M 1s 2020-04-28T12:42:07.226 INFO:teuthology.orchestra.run.smithi197.stderr: 12550K .......... .......... .......... .......... .......... 13% 86.0M 1s 2020-04-28T12:42:07.226 INFO:teuthology.orchestra.run.smithi197.stderr: 12600K .......... .......... .......... .......... .......... 13% 112M 1s 2020-04-28T12:42:07.226 INFO:teuthology.orchestra.run.smithi197.stderr: 12650K .......... .......... .......... .......... .......... 13% 119M 1s 2020-04-28T12:42:07.227 INFO:teuthology.orchestra.run.smithi197.stderr: 12700K .......... .......... .......... .......... .......... 13% 114M 1s 2020-04-28T12:42:07.227 INFO:teuthology.orchestra.run.smithi197.stderr: 12750K .......... .......... .......... .......... .......... 13% 103M 1s 2020-04-28T12:42:07.227 INFO:teuthology.orchestra.run.smithi197.stderr: 12800K .......... .......... .......... .......... .......... 13% 116M 1s 2020-04-28T12:42:07.227 INFO:teuthology.orchestra.run.smithi197.stderr: 12850K .......... .......... .......... .......... .......... 13% 120M 1s 2020-04-28T12:42:07.227 INFO:teuthology.orchestra.run.smithi197.stderr: 12900K .......... .......... .......... .......... .......... 13% 117M 1s 2020-04-28T12:42:07.227 INFO:teuthology.orchestra.run.smithi197.stderr: 12950K .......... .......... .......... .......... .......... 13% 88.3M 1s 2020-04-28T12:42:07.228 INFO:teuthology.orchestra.run.smithi197.stderr: 13000K .......... .......... .......... .......... .......... 14% 115M 1s 2020-04-28T12:42:07.228 INFO:teuthology.orchestra.run.smithi197.stderr: 13050K .......... .......... .......... .......... .......... 14% 115M 1s 2020-04-28T12:42:07.228 INFO:teuthology.orchestra.run.smithi197.stderr: 13100K .......... .......... .......... .......... .......... 14% 115M 1s 2020-04-28T12:42:07.228 INFO:teuthology.orchestra.run.smithi197.stderr: 13150K .......... .......... .......... .......... .......... 14% 109M 1s 2020-04-28T12:42:07.228 INFO:teuthology.orchestra.run.smithi197.stderr: 13200K .......... .......... .......... .......... .......... 14% 120M 1s 2020-04-28T12:42:07.228 INFO:teuthology.orchestra.run.smithi197.stderr: 13250K .......... .......... .......... .......... .......... 14% 114M 1s 2020-04-28T12:42:07.228 INFO:teuthology.orchestra.run.smithi197.stderr: 13300K .......... .......... .......... .......... .......... 14% 121M 1s 2020-04-28T12:42:07.229 INFO:teuthology.orchestra.run.smithi197.stderr: 13350K .......... .......... .......... .......... .......... 14% 88.2M 1s 2020-04-28T12:42:07.229 INFO:teuthology.orchestra.run.smithi197.stderr: 13400K .......... .......... .......... .......... .......... 14% 118M 1s 2020-04-28T12:42:07.229 INFO:teuthology.orchestra.run.smithi197.stderr: 13450K .......... .......... .......... .......... .......... 14% 110M 1s 2020-04-28T12:42:07.229 INFO:teuthology.orchestra.run.smithi197.stderr: 13500K .......... .......... .......... .......... .......... 14% 103M 1s 2020-04-28T12:42:07.229 INFO:teuthology.orchestra.run.smithi197.stderr: 13550K .......... .......... .......... .......... .......... 14% 125M 1s 2020-04-28T12:42:07.230 INFO:teuthology.orchestra.run.smithi197.stderr: 13600K .......... .......... .......... .......... .......... 14% 120M 1s 2020-04-28T12:42:07.230 INFO:teuthology.orchestra.run.smithi197.stderr: 13650K .......... .......... .......... .......... .......... 14% 115M 1s 2020-04-28T12:42:07.230 INFO:teuthology.orchestra.run.smithi197.stderr: 13700K .......... .......... .......... .......... .......... 14% 121M 1s 2020-04-28T12:42:07.230 INFO:teuthology.orchestra.run.smithi197.stderr: 13750K .......... .......... .......... .......... .......... 14% 87.0M 1s 2020-04-28T12:42:07.230 INFO:teuthology.orchestra.run.smithi197.stderr: 13800K .......... .......... .......... .......... .......... 14% 122M 1s 2020-04-28T12:42:07.230 INFO:teuthology.orchestra.run.smithi197.stderr: 13850K .......... .......... .......... .......... .......... 14% 114M 1s 2020-04-28T12:42:07.231 INFO:teuthology.orchestra.run.smithi197.stderr: 13900K .......... .......... .......... .......... .......... 15% 113M 1s 2020-04-28T12:42:07.231 INFO:teuthology.orchestra.run.smithi197.stderr: 13950K .......... .......... .......... .......... .......... 15% 117M 1s 2020-04-28T12:42:07.231 INFO:teuthology.orchestra.run.smithi197.stderr: 14000K .......... .......... .......... .......... .......... 15% 119M 1s 2020-04-28T12:42:07.231 INFO:teuthology.orchestra.run.smithi197.stderr: 14050K .......... .......... .......... .......... .......... 15% 115M 1s 2020-04-28T12:42:07.231 INFO:teuthology.orchestra.run.smithi197.stderr: 14100K .......... .......... .......... .......... .......... 15% 110M 1s 2020-04-28T12:42:07.231 INFO:teuthology.orchestra.run.smithi197.stderr: 14150K .......... .......... .......... .......... .......... 15% 88.7M 1s 2020-04-28T12:42:07.232 INFO:teuthology.orchestra.run.smithi197.stderr: 14200K .......... .......... .......... .......... .......... 15% 119M 1s 2020-04-28T12:42:07.232 INFO:teuthology.orchestra.run.smithi197.stderr: 14250K .......... .......... .......... .......... .......... 15% 108M 1s 2020-04-28T12:42:07.232 INFO:teuthology.orchestra.run.smithi197.stderr: 14300K .......... .......... .......... .......... .......... 15% 123M 1s 2020-04-28T12:42:07.232 INFO:teuthology.orchestra.run.smithi197.stderr: 14350K .......... .......... .......... .......... .......... 15% 111M 1s 2020-04-28T12:42:07.232 INFO:teuthology.orchestra.run.smithi197.stderr: 14400K .......... .......... .......... .......... .......... 15% 103M 1s 2020-04-28T12:42:07.232 INFO:teuthology.orchestra.run.smithi197.stderr: 14450K .......... .......... .......... .......... .......... 15% 117M 1s 2020-04-28T12:42:07.233 INFO:teuthology.orchestra.run.smithi197.stderr: 14500K .......... .......... .......... .......... .......... 15% 115M 1s 2020-04-28T12:42:07.233 INFO:teuthology.orchestra.run.smithi197.stderr: 14550K .......... .......... .......... .......... .......... 15% 111M 1s 2020-04-28T12:42:07.233 INFO:teuthology.orchestra.run.smithi197.stderr: 14600K .......... .......... .......... .......... .......... 15% 117M 1s 2020-04-28T12:42:07.233 INFO:teuthology.orchestra.run.smithi197.stderr: 14650K .......... .......... .......... .......... .......... 15% 107M 1s 2020-04-28T12:42:07.233 INFO:teuthology.orchestra.run.smithi197.stderr: 14700K .......... .......... .......... .......... .......... 15% 118M 1s 2020-04-28T12:42:07.233 INFO:teuthology.orchestra.run.smithi197.stderr: 14750K .......... .......... .......... .......... .......... 15% 86.9M 1s 2020-04-28T12:42:07.233 INFO:teuthology.orchestra.run.smithi197.stderr: 14800K .......... .......... .......... .......... .......... 15% 117M 1s 2020-04-28T12:42:07.234 INFO:teuthology.orchestra.run.smithi197.stderr: 14850K .......... .......... .......... .......... .......... 16% 114M 1s 2020-04-28T12:42:07.234 INFO:teuthology.orchestra.run.smithi197.stderr: 14900K .......... .......... .......... .......... .......... 16% 114M 1s 2020-04-28T12:42:07.234 INFO:teuthology.orchestra.run.smithi197.stderr: 14950K .......... .......... .......... .......... .......... 16% 107M 1s 2020-04-28T12:42:07.234 INFO:teuthology.orchestra.run.smithi197.stderr: 15000K .......... .......... .......... .......... .......... 16% 112M 1s 2020-04-28T12:42:07.234 INFO:teuthology.orchestra.run.smithi197.stderr: 15050K .......... .......... .......... .......... .......... 16% 104M 1s 2020-04-28T12:42:07.234 INFO:teuthology.orchestra.run.smithi197.stderr: 15100K .......... .......... .......... .......... .......... 16% 115M 1s 2020-04-28T12:42:07.235 INFO:teuthology.orchestra.run.smithi197.stderr: 15150K .......... .......... .......... .......... .......... 16% 118M 1s 2020-04-28T12:42:07.235 INFO:teuthology.orchestra.run.smithi197.stderr: 15200K .......... .......... .......... .......... .......... 16% 111M 1s 2020-04-28T12:42:07.235 INFO:teuthology.orchestra.run.smithi197.stderr: 15250K .......... .......... .......... .......... .......... 16% 114M 1s 2020-04-28T12:42:07.235 INFO:teuthology.orchestra.run.smithi197.stderr: 15300K .......... .......... .......... .......... .......... 16% 118M 1s 2020-04-28T12:42:07.235 INFO:teuthology.orchestra.run.smithi197.stderr: 15350K .......... .......... .......... .......... .......... 16% 90.7M 1s 2020-04-28T12:42:07.235 INFO:teuthology.orchestra.run.smithi197.stderr: 15400K .......... .......... .......... .......... .......... 16% 114M 1s 2020-04-28T12:42:07.236 INFO:teuthology.orchestra.run.smithi197.stderr: 15450K .......... .......... .......... .......... .......... 16% 118M 1s 2020-04-28T12:42:07.236 INFO:teuthology.orchestra.run.smithi197.stderr: 15500K .......... .......... .......... .......... .......... 16% 116M 1s 2020-04-28T12:42:07.237 INFO:teuthology.orchestra.run.smithi197.stderr: 15550K .......... .......... .......... .......... .......... 16% 99.5M 1s 2020-04-28T12:42:07.237 INFO:teuthology.orchestra.run.smithi197.stderr: 15600K .......... .......... .......... .......... .......... 16% 128M 1s 2020-04-28T12:42:07.237 INFO:teuthology.orchestra.run.smithi197.stderr: 15650K .......... .......... .......... .......... .......... 16% 114M 1s 2020-04-28T12:42:07.237 INFO:teuthology.orchestra.run.smithi197.stderr: 15700K .......... .......... .......... .......... .......... 16% 115M 1s 2020-04-28T12:42:07.237 INFO:teuthology.orchestra.run.smithi197.stderr: 15750K .......... .......... .......... .......... .......... 17% 84.0M 1s 2020-04-28T12:42:07.237 INFO:teuthology.orchestra.run.smithi197.stderr: 15800K .......... .......... .......... .......... .......... 17% 138M 1s 2020-04-28T12:42:07.238 INFO:teuthology.orchestra.run.smithi197.stderr: 15850K .......... .......... .......... .......... .......... 17% 107M 1s 2020-04-28T12:42:07.238 INFO:teuthology.orchestra.run.smithi197.stderr: 15900K .......... .......... .......... .......... .......... 17% 124M 1s 2020-04-28T12:42:07.238 INFO:teuthology.orchestra.run.smithi197.stderr: 15950K .......... .......... .......... .......... .......... 17% 109M 1s 2020-04-28T12:42:07.238 INFO:teuthology.orchestra.run.smithi197.stderr: 16000K .......... .......... .......... .......... .......... 17% 115M 1s 2020-04-28T12:42:07.238 INFO:teuthology.orchestra.run.smithi197.stderr: 16050K .......... .......... .......... .......... .......... 17% 114M 1s 2020-04-28T12:42:07.238 INFO:teuthology.orchestra.run.smithi197.stderr: 16100K .......... .......... .......... .......... .......... 17% 112M 1s 2020-04-28T12:42:07.238 INFO:teuthology.orchestra.run.smithi197.stderr: 16150K .......... .......... .......... .......... .......... 17% 90.2M 1s 2020-04-28T12:42:07.239 INFO:teuthology.orchestra.run.smithi197.stderr: 16200K .......... .......... .......... .......... .......... 17% 117M 1s 2020-04-28T12:42:07.239 INFO:teuthology.orchestra.run.smithi197.stderr: 16250K .......... .......... .......... .......... .......... 17% 115M 1s 2020-04-28T12:42:07.239 INFO:teuthology.orchestra.run.smithi197.stderr: 16300K .......... .......... .......... .......... .......... 17% 120M 1s 2020-04-28T12:42:07.239 INFO:teuthology.orchestra.run.smithi197.stderr: 16350K .......... .......... .......... .......... .......... 17% 97.8M 1s 2020-04-28T12:42:07.239 INFO:teuthology.orchestra.run.smithi197.stderr: 16400K .......... .......... .......... .......... .......... 17% 133M 1s 2020-04-28T12:42:07.239 INFO:teuthology.orchestra.run.smithi197.stderr: 16450K .......... .......... .......... .......... .......... 17% 107M 1s 2020-04-28T12:42:07.239 INFO:teuthology.orchestra.run.smithi197.stderr: 16500K .......... .......... .......... .......... .......... 17% 120M 1s 2020-04-28T12:42:07.240 INFO:teuthology.orchestra.run.smithi197.stderr: 16550K .......... .......... .......... .......... .......... 17% 91.8M 1s 2020-04-28T12:42:07.240 INFO:teuthology.orchestra.run.smithi197.stderr: 16600K .......... .......... .......... .......... .......... 17% 112M 1s 2020-04-28T12:42:07.240 INFO:teuthology.orchestra.run.smithi197.stderr: 16650K .......... .......... .......... .......... .......... 17% 119M 1s 2020-04-28T12:42:07.240 INFO:teuthology.orchestra.run.smithi197.stderr: 16700K .......... .......... .......... .......... .......... 18% 117M 1s 2020-04-28T12:42:07.240 INFO:teuthology.orchestra.run.smithi197.stderr: 16750K .......... .......... .......... .......... .......... 18% 112M 1s 2020-04-28T12:42:07.240 INFO:teuthology.orchestra.run.smithi197.stderr: 16800K .......... .......... .......... .......... .......... 18% 106M 1s 2020-04-28T12:42:07.240 INFO:teuthology.orchestra.run.smithi197.stderr: 16850K .......... .......... .......... .......... .......... 18% 127M 1s 2020-04-28T12:42:07.241 INFO:teuthology.orchestra.run.smithi197.stderr: 16900K .......... .......... .......... .......... .......... 18% 114M 1s 2020-04-28T12:42:07.241 INFO:teuthology.orchestra.run.smithi197.stderr: 16950K .......... .......... .......... .......... .......... 18% 74.0M 1s 2020-04-28T12:42:07.241 INFO:teuthology.orchestra.run.smithi197.stderr: 17000K .......... .......... .......... .......... .......... 18% 161M 1s 2020-04-28T12:42:07.241 INFO:teuthology.orchestra.run.smithi197.stderr: 17050K .......... .......... .......... .......... .......... 18% 118M 1s 2020-04-28T12:42:07.241 INFO:teuthology.orchestra.run.smithi197.stderr: 17100K .......... .......... .......... .......... .......... 18% 109M 1s 2020-04-28T12:42:07.241 INFO:teuthology.orchestra.run.smithi197.stderr: 17150K .......... .......... .......... .......... .......... 18% 120M 1s 2020-04-28T12:42:07.241 INFO:teuthology.orchestra.run.smithi197.stderr: 17200K .......... .......... .......... .......... .......... 18% 109M 1s 2020-04-28T12:42:07.242 INFO:teuthology.orchestra.run.smithi197.stderr: 17250K .......... .......... .......... .......... .......... 18% 121M 1s 2020-04-28T12:42:07.242 INFO:teuthology.orchestra.run.smithi197.stderr: 17300K .......... .......... .......... .......... .......... 18% 117M 1s 2020-04-28T12:42:07.242 INFO:teuthology.orchestra.run.smithi197.stderr: 17350K .......... .......... .......... .......... .......... 18% 90.6M 1s 2020-04-28T12:42:07.242 INFO:teuthology.orchestra.run.smithi197.stderr: 17400K .......... .......... .......... .......... .......... 18% 118M 1s 2020-04-28T12:42:07.242 INFO:teuthology.orchestra.run.smithi197.stderr: 17450K .......... .......... .......... .......... .......... 18% 116M 1s 2020-04-28T12:42:07.242 INFO:teuthology.orchestra.run.smithi197.stderr: 17500K .......... .......... .......... .......... .......... 18% 113M 1s 2020-04-28T12:42:07.242 INFO:teuthology.orchestra.run.smithi197.stderr: 17550K .......... .......... .......... .......... .......... 18% 119M 1s 2020-04-28T12:42:07.243 INFO:teuthology.orchestra.run.smithi197.stderr: 17600K .......... .......... .......... .......... .......... 18% 117M 1s 2020-04-28T12:42:07.243 INFO:teuthology.orchestra.run.smithi197.stderr: 17650K .......... .......... .......... .......... .......... 19% 114M 1s 2020-04-28T12:42:07.243 INFO:teuthology.orchestra.run.smithi197.stderr: 17700K .......... .......... .......... .......... .......... 19% 118M 1s 2020-04-28T12:42:07.243 INFO:teuthology.orchestra.run.smithi197.stderr: 17750K .......... .......... .......... .......... .......... 19% 90.9M 1s 2020-04-28T12:42:07.243 INFO:teuthology.orchestra.run.smithi197.stderr: 17800K .......... .......... .......... .......... .......... 19% 117M 1s 2020-04-28T12:42:07.243 INFO:teuthology.orchestra.run.smithi197.stderr: 17850K .......... .......... .......... .......... .......... 19% 109M 1s 2020-04-28T12:42:07.243 INFO:teuthology.orchestra.run.smithi197.stderr: 17900K .......... .......... .......... .......... .......... 19% 124M 1s 2020-04-28T12:42:07.244 INFO:teuthology.orchestra.run.smithi197.stderr: 17950K .......... .......... .......... .......... .......... 19% 86.3M 1s 2020-04-28T12:42:07.244 INFO:teuthology.orchestra.run.smithi197.stderr: 18000K .......... .......... .......... .......... .......... 19% 119M 1s 2020-04-28T12:42:07.244 INFO:teuthology.orchestra.run.smithi197.stderr: 18050K .......... .......... .......... .......... .......... 19% 103M 1s 2020-04-28T12:42:07.244 INFO:teuthology.orchestra.run.smithi197.stderr: 18100K .......... .......... .......... .......... .......... 19% 110M 1s 2020-04-28T12:42:07.244 INFO:teuthology.orchestra.run.smithi197.stderr: 18150K .......... .......... .......... .......... .......... 19% 95.6M 1s 2020-04-28T12:42:07.244 INFO:teuthology.orchestra.run.smithi197.stderr: 18200K .......... .......... .......... .......... .......... 19% 118M 1s 2020-04-28T12:42:07.245 INFO:teuthology.orchestra.run.smithi197.stderr: 18250K .......... .......... .......... .......... .......... 19% 108M 1s 2020-04-28T12:42:07.245 INFO:teuthology.orchestra.run.smithi197.stderr: 18300K .......... .......... .......... .......... .......... 19% 112M 1s 2020-04-28T12:42:07.245 INFO:teuthology.orchestra.run.smithi197.stderr: 18350K .......... .......... .......... .......... .......... 19% 115M 1s 2020-04-28T12:42:07.245 INFO:teuthology.orchestra.run.smithi197.stderr: 18400K .......... .......... .......... .......... .......... 19% 118M 1s 2020-04-28T12:42:07.245 INFO:teuthology.orchestra.run.smithi197.stderr: 18450K .......... .......... .......... .......... .......... 19% 111M 1s 2020-04-28T12:42:07.245 INFO:teuthology.orchestra.run.smithi197.stderr: 18500K .......... .......... .......... .......... .......... 19% 108M 1s 2020-04-28T12:42:07.245 INFO:teuthology.orchestra.run.smithi197.stderr: 18550K .......... .......... .......... .......... .......... 20% 91.4M 1s 2020-04-28T12:42:07.246 INFO:teuthology.orchestra.run.smithi197.stderr: 18600K .......... .......... .......... .......... .......... 20% 118M 1s 2020-04-28T12:42:07.246 INFO:teuthology.orchestra.run.smithi197.stderr: 18650K .......... .......... .......... .......... .......... 20% 117M 1s 2020-04-28T12:42:07.246 INFO:teuthology.orchestra.run.smithi197.stderr: 18700K .......... .......... .......... .......... .......... 20% 116M 1s 2020-04-28T12:42:07.246 INFO:teuthology.orchestra.run.smithi197.stderr: 18750K .......... .......... .......... .......... .......... 20% 115M 1s 2020-04-28T12:42:07.246 INFO:teuthology.orchestra.run.smithi197.stderr: 18800K .......... .......... .......... .......... .......... 20% 110M 1s 2020-04-28T12:42:07.246 INFO:teuthology.orchestra.run.smithi197.stderr: 18850K .......... .......... .......... .......... .......... 20% 119M 1s 2020-04-28T12:42:07.246 INFO:teuthology.orchestra.run.smithi197.stderr: 18900K .......... .......... .......... .......... .......... 20% 108M 1s 2020-04-28T12:42:07.247 INFO:teuthology.orchestra.run.smithi197.stderr: 18950K .......... .......... .......... .......... .......... 20% 92.2M 1s 2020-04-28T12:42:07.247 INFO:teuthology.orchestra.run.smithi197.stderr: 19000K .......... .......... .......... .......... .......... 20% 112M 1s 2020-04-28T12:42:07.247 INFO:teuthology.orchestra.run.smithi197.stderr: 19050K .......... .......... .......... .......... .......... 20% 117M 1s 2020-04-28T12:42:07.247 INFO:teuthology.orchestra.run.smithi197.stderr: 19100K .......... .......... .......... .......... .......... 20% 118M 1s 2020-04-28T12:42:07.247 INFO:teuthology.orchestra.run.smithi197.stderr: 19150K .......... .......... .......... .......... .......... 20% 117M 1s 2020-04-28T12:42:07.247 INFO:teuthology.orchestra.run.smithi197.stderr: 19200K .......... .......... .......... .......... .......... 20% 104M 1s 2020-04-28T12:42:07.247 INFO:teuthology.orchestra.run.smithi197.stderr: 19250K .......... .......... .......... .......... .......... 20% 120M 1s 2020-04-28T12:42:07.248 INFO:teuthology.orchestra.run.smithi197.stderr: 19300K .......... .......... .......... .......... .......... 20% 115M 1s 2020-04-28T12:42:07.248 INFO:teuthology.orchestra.run.smithi197.stderr: 19350K .......... .......... .......... .......... .......... 20% 89.2M 1s 2020-04-28T12:42:07.248 INFO:teuthology.orchestra.run.smithi197.stderr: 19400K .......... .......... .......... .......... .......... 20% 109M 1s 2020-04-28T12:42:07.248 INFO:teuthology.orchestra.run.smithi197.stderr: 19450K .......... .......... .......... .......... .......... 20% 127M 1s 2020-04-28T12:42:07.248 INFO:teuthology.orchestra.run.smithi197.stderr: 19500K .......... .......... .......... .......... .......... 21% 117M 1s 2020-04-28T12:42:07.248 INFO:teuthology.orchestra.run.smithi197.stderr: 19550K .......... .......... .......... .......... .......... 21% 105M 1s 2020-04-28T12:42:07.249 INFO:teuthology.orchestra.run.smithi197.stderr: 19600K .......... .......... .......... .......... .......... 21% 119M 1s 2020-04-28T12:42:07.249 INFO:teuthology.orchestra.run.smithi197.stderr: 19650K .......... .......... .......... .......... .......... 21% 116M 1s 2020-04-28T12:42:07.249 INFO:teuthology.orchestra.run.smithi197.stderr: 19700K .......... .......... .......... .......... .......... 21% 117M 1s 2020-04-28T12:42:07.249 INFO:teuthology.orchestra.run.smithi197.stderr: 19750K .......... .......... .......... .......... .......... 21% 91.6M 1s 2020-04-28T12:42:07.249 INFO:teuthology.orchestra.run.smithi197.stderr: 19800K .......... .......... .......... .......... .......... 21% 114M 1s 2020-04-28T12:42:07.249 INFO:teuthology.orchestra.run.smithi197.stderr: 19850K .......... .......... .......... .......... .......... 21% 109M 1s 2020-04-28T12:42:07.249 INFO:teuthology.orchestra.run.smithi197.stderr: 19900K .......... .......... .......... .......... .......... 21% 119M 1s 2020-04-28T12:42:07.250 INFO:teuthology.orchestra.run.smithi197.stderr: 19950K .......... .......... .......... .......... .......... 21% 113M 1s 2020-04-28T12:42:07.250 INFO:teuthology.orchestra.run.smithi197.stderr: 20000K .......... .......... .......... .......... .......... 21% 105M 1s 2020-04-28T12:42:07.250 INFO:teuthology.orchestra.run.smithi197.stderr: 20050K .......... .......... .......... .......... .......... 21% 120M 1s 2020-04-28T12:42:07.250 INFO:teuthology.orchestra.run.smithi197.stderr: 20100K .......... .......... .......... .......... .......... 21% 118M 1s 2020-04-28T12:42:07.250 INFO:teuthology.orchestra.run.smithi197.stderr: 20150K .......... .......... .......... .......... .......... 21% 88.3M 1s 2020-04-28T12:42:07.250 INFO:teuthology.orchestra.run.smithi197.stderr: 20200K .......... .......... .......... .......... .......... 21% 108M 1s 2020-04-28T12:42:07.251 INFO:teuthology.orchestra.run.smithi197.stderr: 20250K .......... .......... .......... .......... .......... 21% 121M 1s 2020-04-28T12:42:07.251 INFO:teuthology.orchestra.run.smithi197.stderr: 20300K .......... .......... .......... .......... .......... 21% 112M 1s 2020-04-28T12:42:07.251 INFO:teuthology.orchestra.run.smithi197.stderr: 20350K .......... .......... .......... .......... .......... 21% 109M 1s 2020-04-28T12:42:07.251 INFO:teuthology.orchestra.run.smithi197.stderr: 20400K .......... .......... .......... .......... .......... 22% 112M 1s 2020-04-28T12:42:07.251 INFO:teuthology.orchestra.run.smithi197.stderr: 20450K .......... .......... .......... .......... .......... 22% 104M 1s 2020-04-28T12:42:07.251 INFO:teuthology.orchestra.run.smithi197.stderr: 20500K .......... .......... .......... .......... .......... 22% 109M 1s 2020-04-28T12:42:07.251 INFO:teuthology.orchestra.run.smithi197.stderr: 20550K .......... .......... .......... .......... .......... 22% 82.3M 1s 2020-04-28T12:42:07.252 INFO:teuthology.orchestra.run.smithi197.stderr: 20600K .......... .......... .......... .......... .......... 22% 143M 1s 2020-04-28T12:42:07.252 INFO:teuthology.orchestra.run.smithi197.stderr: 20650K .......... .......... .......... .......... .......... 22% 123M 1s 2020-04-28T12:42:07.252 INFO:teuthology.orchestra.run.smithi197.stderr: 20700K .......... .......... .......... .......... .......... 22% 113M 1s 2020-04-28T12:42:07.252 INFO:teuthology.orchestra.run.smithi197.stderr: 20750K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:42:07.252 INFO:teuthology.orchestra.run.smithi197.stderr: 20800K .......... .......... .......... .......... .......... 22% 117M 1s 2020-04-28T12:42:07.252 INFO:teuthology.orchestra.run.smithi197.stderr: 20850K .......... .......... .......... .......... .......... 22% 108M 1s 2020-04-28T12:42:07.252 INFO:teuthology.orchestra.run.smithi197.stderr: 20900K .......... .......... .......... .......... .......... 22% 129M 1s 2020-04-28T12:42:07.253 INFO:teuthology.orchestra.run.smithi197.stderr: 20950K .......... .......... .......... .......... .......... 22% 88.4M 1s 2020-04-28T12:42:07.253 INFO:teuthology.orchestra.run.smithi197.stderr: 21000K .......... .......... .......... .......... .......... 22% 119M 1s 2020-04-28T12:42:07.253 INFO:teuthology.orchestra.run.smithi197.stderr: 21050K .......... .......... .......... .......... .......... 22% 112M 1s 2020-04-28T12:42:07.253 INFO:teuthology.orchestra.run.smithi197.stderr: 21100K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:42:07.253 INFO:teuthology.orchestra.run.smithi197.stderr: 21150K .......... .......... .......... .......... .......... 22% 114M 1s 2020-04-28T12:42:07.253 INFO:teuthology.orchestra.run.smithi197.stderr: 21200K .......... .......... .......... .......... .......... 22% 115M 1s 2020-04-28T12:42:07.253 INFO:teuthology.orchestra.run.smithi197.stderr: 21250K .......... .......... .......... .......... .......... 22% 111M 1s 2020-04-28T12:42:07.254 INFO:teuthology.orchestra.run.smithi197.stderr: 21300K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:42:07.254 INFO:teuthology.orchestra.run.smithi197.stderr: 21350K .......... .......... .......... .......... .......... 23% 85.4M 1s 2020-04-28T12:42:07.254 INFO:teuthology.orchestra.run.smithi197.stderr: 21400K .......... .......... .......... .......... .......... 23% 126M 1s 2020-04-28T12:42:07.254 INFO:teuthology.orchestra.run.smithi197.stderr: 21450K .......... .......... .......... .......... .......... 23% 109M 1s 2020-04-28T12:42:07.254 INFO:teuthology.orchestra.run.smithi197.stderr: 21500K .......... .......... .......... .......... .......... 23% 111M 1s 2020-04-28T12:42:07.254 INFO:teuthology.orchestra.run.smithi197.stderr: 21550K .......... .......... .......... .......... .......... 23% 109M 1s 2020-04-28T12:42:07.254 INFO:teuthology.orchestra.run.smithi197.stderr: 21600K .......... .......... .......... .......... .......... 23% 113M 1s 2020-04-28T12:42:07.255 INFO:teuthology.orchestra.run.smithi197.stderr: 21650K .......... .......... .......... .......... .......... 23% 121M 1s 2020-04-28T12:42:07.255 INFO:teuthology.orchestra.run.smithi197.stderr: 21700K .......... .......... .......... .......... .......... 23% 111M 1s 2020-04-28T12:42:07.255 INFO:teuthology.orchestra.run.smithi197.stderr: 21750K .......... .......... .......... .......... .......... 23% 83.1M 1s 2020-04-28T12:42:07.255 INFO:teuthology.orchestra.run.smithi197.stderr: 21800K .......... .......... .......... .......... .......... 23% 122M 1s 2020-04-28T12:42:07.255 INFO:teuthology.orchestra.run.smithi197.stderr: 21850K .......... .......... .......... .......... .......... 23% 107M 1s 2020-04-28T12:42:07.255 INFO:teuthology.orchestra.run.smithi197.stderr: 21900K .......... .......... .......... .......... .......... 23% 115M 1s 2020-04-28T12:42:07.255 INFO:teuthology.orchestra.run.smithi197.stderr: 21950K .......... .......... .......... .......... .......... 23% 118M 1s 2020-04-28T12:42:07.256 INFO:teuthology.orchestra.run.smithi197.stderr: 22000K .......... .......... .......... .......... .......... 23% 108M 1s 2020-04-28T12:42:07.256 INFO:teuthology.orchestra.run.smithi197.stderr: 22050K .......... .......... .......... .......... .......... 23% 118M 1s 2020-04-28T12:42:07.256 INFO:teuthology.orchestra.run.smithi197.stderr: 22100K .......... .......... .......... .......... .......... 23% 119M 1s 2020-04-28T12:42:07.256 INFO:teuthology.orchestra.run.smithi197.stderr: 22150K .......... .......... .......... .......... .......... 23% 86.8M 1s 2020-04-28T12:42:07.256 INFO:teuthology.orchestra.run.smithi197.stderr: 22200K .......... .......... .......... .......... .......... 23% 136M 1s 2020-04-28T12:42:07.256 INFO:teuthology.orchestra.run.smithi197.stderr: 22250K .......... .......... .......... .......... .......... 24% 109M 1s 2020-04-28T12:42:07.256 INFO:teuthology.orchestra.run.smithi197.stderr: 22300K .......... .......... .......... .......... .......... 24% 118M 1s 2020-04-28T12:42:07.257 INFO:teuthology.orchestra.run.smithi197.stderr: 22350K .......... .......... .......... .......... .......... 24% 98.0M 1s 2020-04-28T12:42:07.257 INFO:teuthology.orchestra.run.smithi197.stderr: 22400K .......... .......... .......... .......... .......... 24% 117M 1s 2020-04-28T12:42:07.257 INFO:teuthology.orchestra.run.smithi197.stderr: 22450K .......... .......... .......... .......... .......... 24% 98.1M 1s 2020-04-28T12:42:07.257 INFO:teuthology.orchestra.run.smithi197.stderr: 22500K .......... .......... .......... .......... .......... 24% 125M 1s 2020-04-28T12:42:07.257 INFO:teuthology.orchestra.run.smithi197.stderr: 22550K .......... .......... .......... .......... .......... 24% 88.6M 1s 2020-04-28T12:42:07.257 INFO:teuthology.orchestra.run.smithi197.stderr: 22600K .......... .......... .......... .......... .......... 24% 120M 1s 2020-04-28T12:42:07.257 INFO:teuthology.orchestra.run.smithi197.stderr: 22650K .......... .......... .......... .......... .......... 24% 117M 1s 2020-04-28T12:42:07.258 INFO:teuthology.orchestra.run.smithi197.stderr: 22700K .......... .......... .......... .......... .......... 24% 109M 1s 2020-04-28T12:42:07.258 INFO:teuthology.orchestra.run.smithi197.stderr: 22750K .......... .......... .......... .......... .......... 24% 114M 1s 2020-04-28T12:42:07.258 INFO:teuthology.orchestra.run.smithi197.stderr: 22800K .......... .......... .......... .......... .......... 24% 112M 1s 2020-04-28T12:42:07.258 INFO:teuthology.orchestra.run.smithi197.stderr: 22850K .......... .......... .......... .......... .......... 24% 89.7M 1s 2020-04-28T12:42:07.258 INFO:teuthology.orchestra.run.smithi197.stderr: 22900K .......... .......... .......... .......... .......... 24% 175M 1s 2020-04-28T12:42:07.258 INFO:teuthology.orchestra.run.smithi197.stderr: 22950K .......... .......... .......... .......... .......... 24% 90.7M 1s 2020-04-28T12:42:07.258 INFO:teuthology.orchestra.run.smithi197.stderr: 23000K .......... .......... .......... .......... .......... 24% 108M 1s 2020-04-28T12:42:07.259 INFO:teuthology.orchestra.run.smithi197.stderr: 23050K .......... .......... .......... .......... .......... 24% 127M 1s 2020-04-28T12:42:07.259 INFO:teuthology.orchestra.run.smithi197.stderr: 23100K .......... .......... .......... .......... .......... 24% 116M 1s 2020-04-28T12:42:07.259 INFO:teuthology.orchestra.run.smithi197.stderr: 23150K .......... .......... .......... .......... .......... 24% 109M 1s 2020-04-28T12:42:07.259 INFO:teuthology.orchestra.run.smithi197.stderr: 23200K .......... .......... .......... .......... .......... 25% 115M 1s 2020-04-28T12:42:07.259 INFO:teuthology.orchestra.run.smithi197.stderr: 23250K .......... .......... .......... .......... .......... 25% 114M 1s 2020-04-28T12:42:07.259 INFO:teuthology.orchestra.run.smithi197.stderr: 23300K .......... .......... .......... .......... .......... 25% 119M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23350K .......... .......... .......... .......... .......... 25% 85.3M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23400K .......... .......... .......... .......... .......... 25% 126M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23450K .......... .......... .......... .......... .......... 25% 118M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23500K .......... .......... .......... .......... .......... 25% 117M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23550K .......... .......... .......... .......... .......... 25% 112M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23600K .......... .......... .......... .......... .......... 25% 118M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23650K .......... .......... .......... .......... .......... 25% 116M 1s 2020-04-28T12:42:07.260 INFO:teuthology.orchestra.run.smithi197.stderr: 23700K .......... .......... .......... .......... .......... 25% 112M 1s 2020-04-28T12:42:07.261 INFO:teuthology.orchestra.run.smithi197.stderr: 23750K .......... .......... .......... .......... .......... 25% 90.7M 1s 2020-04-28T12:42:07.261 INFO:teuthology.orchestra.run.smithi197.stderr: 23800K .......... .......... .......... .......... .......... 25% 110M 1s 2020-04-28T12:42:07.261 INFO:teuthology.orchestra.run.smithi197.stderr: 23850K .......... .......... .......... .......... .......... 25% 124M 1s 2020-04-28T12:42:07.261 INFO:teuthology.orchestra.run.smithi197.stderr: 23900K .......... .......... .......... .......... .......... 25% 117M 1s 2020-04-28T12:42:07.261 INFO:teuthology.orchestra.run.smithi197.stderr: 23950K .......... .......... .......... .......... .......... 25% 108M 1s 2020-04-28T12:42:07.261 INFO:teuthology.orchestra.run.smithi197.stderr: 24000K .......... .......... .......... .......... .......... 25% 116M 1s 2020-04-28T12:42:07.262 INFO:teuthology.orchestra.run.smithi197.stderr: 24050K .......... .......... .......... .......... .......... 25% 118M 1s 2020-04-28T12:42:07.262 INFO:teuthology.orchestra.run.smithi197.stderr: 24100K .......... .......... .......... .......... .......... 25% 114M 1s 2020-04-28T12:42:07.262 INFO:teuthology.orchestra.run.smithi197.stderr: 24150K .......... .......... .......... .......... .......... 26% 89.2M 1s 2020-04-28T12:42:07.262 INFO:teuthology.orchestra.run.smithi197.stderr: 24200K .......... .......... .......... .......... .......... 26% 116M 1s 2020-04-28T12:42:07.262 INFO:teuthology.orchestra.run.smithi197.stderr: 24250K .......... .......... .......... .......... .......... 26% 113M 1s 2020-04-28T12:42:07.262 INFO:teuthology.orchestra.run.smithi197.stderr: 24300K .......... .......... .......... .......... .......... 26% 110M 1s 2020-04-28T12:42:07.262 INFO:teuthology.orchestra.run.smithi197.stderr: 24350K .......... .......... .......... .......... .......... 26% 105M 1s 2020-04-28T12:42:07.263 INFO:teuthology.orchestra.run.smithi197.stderr: 24400K .......... .......... .......... .......... .......... 26% 136M 1s 2020-04-28T12:42:07.263 INFO:teuthology.orchestra.run.smithi197.stderr: 24450K .......... .......... .......... .......... .......... 26% 116M 1s 2020-04-28T12:42:07.263 INFO:teuthology.orchestra.run.smithi197.stderr: 24500K .......... .......... .......... .......... .......... 26% 119M 1s 2020-04-28T12:42:07.263 INFO:teuthology.orchestra.run.smithi197.stderr: 24550K .......... .......... .......... .......... .......... 26% 88.8M 1s 2020-04-28T12:42:07.263 INFO:teuthology.orchestra.run.smithi197.stderr: 24600K .......... .......... .......... .......... .......... 26% 120M 1s 2020-04-28T12:42:07.263 INFO:teuthology.orchestra.run.smithi197.stderr: 24650K .......... .......... .......... .......... .......... 26% 108M 1s 2020-04-28T12:42:07.263 INFO:teuthology.orchestra.run.smithi197.stderr: 24700K .......... .......... .......... .......... .......... 26% 126M 1s 2020-04-28T12:42:07.264 INFO:teuthology.orchestra.run.smithi197.stderr: 24750K .......... .......... .......... .......... .......... 26% 111M 1s 2020-04-28T12:42:07.264 INFO:teuthology.orchestra.run.smithi197.stderr: 24800K .......... .......... .......... .......... .......... 26% 118M 1s 2020-04-28T12:42:07.264 INFO:teuthology.orchestra.run.smithi197.stderr: 24850K .......... .......... .......... .......... .......... 26% 118M 1s 2020-04-28T12:42:07.264 INFO:teuthology.orchestra.run.smithi197.stderr: 24900K .......... .......... .......... .......... .......... 26% 115M 1s 2020-04-28T12:42:07.264 INFO:teuthology.orchestra.run.smithi197.stderr: 24950K .......... .......... .......... .......... .......... 26% 84.3M 1s 2020-04-28T12:42:07.264 INFO:teuthology.orchestra.run.smithi197.stderr: 25000K .......... .......... .......... .......... .......... 26% 119M 1s 2020-04-28T12:42:07.264 INFO:teuthology.orchestra.run.smithi197.stderr: 25050K .......... .......... .......... .......... .......... 27% 115M 1s 2020-04-28T12:42:07.265 INFO:teuthology.orchestra.run.smithi197.stderr: 25100K .......... .......... .......... .......... .......... 27% 118M 1s 2020-04-28T12:42:07.265 INFO:teuthology.orchestra.run.smithi197.stderr: 25150K .......... .......... .......... .......... .......... 27% 111M 1s 2020-04-28T12:42:07.265 INFO:teuthology.orchestra.run.smithi197.stderr: 25200K .......... .......... .......... .......... .......... 27% 113M 1s 2020-04-28T12:42:07.265 INFO:teuthology.orchestra.run.smithi197.stderr: 25250K .......... .......... .......... .......... .......... 27% 118M 1s 2020-04-28T12:42:07.265 INFO:teuthology.orchestra.run.smithi197.stderr: 25300K .......... .......... .......... .......... .......... 27% 117M 1s 2020-04-28T12:42:07.265 INFO:teuthology.orchestra.run.smithi197.stderr: 25350K .......... .......... .......... .......... .......... 27% 86.8M 1s 2020-04-28T12:42:07.265 INFO:teuthology.orchestra.run.smithi197.stderr: 25400K .......... .......... .......... .......... .......... 27% 118M 1s 2020-04-28T12:42:07.266 INFO:teuthology.orchestra.run.smithi197.stderr: 25450K .......... .......... .......... .......... .......... 27% 114M 1s 2020-04-28T12:42:07.266 INFO:teuthology.orchestra.run.smithi197.stderr: 25500K .......... .......... .......... .......... .......... 27% 104M 1s 2020-04-28T12:42:07.266 INFO:teuthology.orchestra.run.smithi197.stderr: 25550K .......... .......... .......... .......... .......... 27% 111M 1s 2020-04-28T12:42:07.266 INFO:teuthology.orchestra.run.smithi197.stderr: 25600K .......... .......... .......... .......... .......... 27% 112M 1s 2020-04-28T12:42:07.266 INFO:teuthology.orchestra.run.smithi197.stderr: 25650K .......... .......... .......... .......... .......... 27% 118M 1s 2020-04-28T12:42:07.266 INFO:teuthology.orchestra.run.smithi197.stderr: 25700K .......... .......... .......... .......... .......... 27% 105M 1s 2020-04-28T12:42:07.266 INFO:teuthology.orchestra.run.smithi197.stderr: 25750K .......... .......... .......... .......... .......... 27% 87.8M 1s 2020-04-28T12:42:07.267 INFO:teuthology.orchestra.run.smithi197.stderr: 25800K .......... .......... .......... .......... .......... 27% 119M 1s 2020-04-28T12:42:07.267 INFO:teuthology.orchestra.run.smithi197.stderr: 25850K .......... .......... .......... .......... .......... 27% 108M 1s 2020-04-28T12:42:07.267 INFO:teuthology.orchestra.run.smithi197.stderr: 25900K .......... .......... .......... .......... .......... 27% 117M 1s 2020-04-28T12:42:07.267 INFO:teuthology.orchestra.run.smithi197.stderr: 25950K .......... .......... .......... .......... .......... 27% 113M 1s 2020-04-28T12:42:07.267 INFO:teuthology.orchestra.run.smithi197.stderr: 26000K .......... .......... .......... .......... .......... 28% 118M 1s 2020-04-28T12:42:07.267 INFO:teuthology.orchestra.run.smithi197.stderr: 26050K .......... .......... .......... .......... .......... 28% 114M 1s 2020-04-28T12:42:07.267 INFO:teuthology.orchestra.run.smithi197.stderr: 26100K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:42:07.268 INFO:teuthology.orchestra.run.smithi197.stderr: 26150K .......... .......... .......... .......... .......... 28% 89.2M 1s 2020-04-28T12:42:07.268 INFO:teuthology.orchestra.run.smithi197.stderr: 26200K .......... .......... .......... .......... .......... 28% 114M 1s 2020-04-28T12:42:07.268 INFO:teuthology.orchestra.run.smithi197.stderr: 26250K .......... .......... .......... .......... .......... 28% 117M 1s 2020-04-28T12:42:07.268 INFO:teuthology.orchestra.run.smithi197.stderr: 26300K .......... .......... .......... .......... .......... 28% 118M 1s 2020-04-28T12:42:07.268 INFO:teuthology.orchestra.run.smithi197.stderr: 26350K .......... .......... .......... .......... .......... 28% 107M 1s 2020-04-28T12:42:07.268 INFO:teuthology.orchestra.run.smithi197.stderr: 26400K .......... .......... .......... .......... .......... 28% 117M 1s 2020-04-28T12:42:07.268 INFO:teuthology.orchestra.run.smithi197.stderr: 26450K .......... .......... .......... .......... .......... 28% 115M 1s 2020-04-28T12:42:07.269 INFO:teuthology.orchestra.run.smithi197.stderr: 26500K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:42:07.269 INFO:teuthology.orchestra.run.smithi197.stderr: 26550K .......... .......... .......... .......... .......... 28% 90.1M 1s 2020-04-28T12:42:07.269 INFO:teuthology.orchestra.run.smithi197.stderr: 26600K .......... .......... .......... .......... .......... 28% 116M 1s 2020-04-28T12:42:07.269 INFO:teuthology.orchestra.run.smithi197.stderr: 26650K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:42:07.269 INFO:teuthology.orchestra.run.smithi197.stderr: 26700K .......... .......... .......... .......... .......... 28% 107M 1s 2020-04-28T12:42:07.269 INFO:teuthology.orchestra.run.smithi197.stderr: 26750K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:42:07.269 INFO:teuthology.orchestra.run.smithi197.stderr: 26800K .......... .......... .......... .......... .......... 28% 130M 1s 2020-04-28T12:42:07.270 INFO:teuthology.orchestra.run.smithi197.stderr: 26850K .......... .......... .......... .......... .......... 28% 114M 1s 2020-04-28T12:42:07.270 INFO:teuthology.orchestra.run.smithi197.stderr: 26900K .......... .......... .......... .......... .......... 29% 106M 1s 2020-04-28T12:42:07.270 INFO:teuthology.orchestra.run.smithi197.stderr: 26950K .......... .......... .......... .......... .......... 29% 92.4M 1s 2020-04-28T12:42:07.270 INFO:teuthology.orchestra.run.smithi197.stderr: 27000K .......... .......... .......... .......... .......... 29% 106M 1s 2020-04-28T12:42:07.270 INFO:teuthology.orchestra.run.smithi197.stderr: 27050K .......... .......... .......... .......... .......... 29% 117M 1s 2020-04-28T12:42:07.270 INFO:teuthology.orchestra.run.smithi197.stderr: 27100K .......... .......... .......... .......... .......... 29% 96.8M 1s 2020-04-28T12:42:07.270 INFO:teuthology.orchestra.run.smithi197.stderr: 27150K .......... .......... .......... .......... .......... 29% 111M 1s 2020-04-28T12:42:07.271 INFO:teuthology.orchestra.run.smithi197.stderr: 27200K .......... .......... .......... .......... .......... 29% 106M 1s 2020-04-28T12:42:07.271 INFO:teuthology.orchestra.run.smithi197.stderr: 27250K .......... .......... .......... .......... .......... 29% 121M 1s 2020-04-28T12:42:07.271 INFO:teuthology.orchestra.run.smithi197.stderr: 27300K .......... .......... .......... .......... .......... 29% 109M 1s 2020-04-28T12:42:07.271 INFO:teuthology.orchestra.run.smithi197.stderr: 27350K .......... .......... .......... .......... .......... 29% 91.1M 1s 2020-04-28T12:42:07.271 INFO:teuthology.orchestra.run.smithi197.stderr: 27400K .......... .......... .......... .......... .......... 29% 113M 1s 2020-04-28T12:42:07.271 INFO:teuthology.orchestra.run.smithi197.stderr: 27450K .......... .......... .......... .......... .......... 29% 113M 1s 2020-04-28T12:42:07.271 INFO:teuthology.orchestra.run.smithi197.stderr: 27500K .......... .......... .......... .......... .......... 29% 117M 1s 2020-04-28T12:42:07.272 INFO:teuthology.orchestra.run.smithi197.stderr: 27550K .......... .......... .......... .......... .......... 29% 105M 1s 2020-04-28T12:42:07.272 INFO:teuthology.orchestra.run.smithi197.stderr: 27600K .......... .......... .......... .......... .......... 29% 121M 1s 2020-04-28T12:42:07.272 INFO:teuthology.orchestra.run.smithi197.stderr: 27650K .......... .......... .......... .......... .......... 29% 116M 1s 2020-04-28T12:42:07.272 INFO:teuthology.orchestra.run.smithi197.stderr: 27700K .......... .......... .......... .......... .......... 29% 120M 1s 2020-04-28T12:42:07.272 INFO:teuthology.orchestra.run.smithi197.stderr: 27750K .......... .......... .......... .......... .......... 29% 81.7M 1s 2020-04-28T12:42:07.272 INFO:teuthology.orchestra.run.smithi197.stderr: 27800K .......... .......... .......... .......... .......... 29% 118M 1s 2020-04-28T12:42:07.272 INFO:teuthology.orchestra.run.smithi197.stderr: 27850K .......... .......... .......... .......... .......... 30% 113M 1s 2020-04-28T12:42:07.273 INFO:teuthology.orchestra.run.smithi197.stderr: 27900K .......... .......... .......... .......... .......... 30% 113M 1s 2020-04-28T12:42:07.273 INFO:teuthology.orchestra.run.smithi197.stderr: 27950K .......... .......... .......... .......... .......... 30% 111M 1s 2020-04-28T12:42:07.273 INFO:teuthology.orchestra.run.smithi197.stderr: 28000K .......... .......... .......... .......... .......... 30% 113M 1s 2020-04-28T12:42:07.273 INFO:teuthology.orchestra.run.smithi197.stderr: 28050K .......... .......... .......... .......... .......... 30% 121M 1s 2020-04-28T12:42:07.273 INFO:teuthology.orchestra.run.smithi197.stderr: 28100K .......... .......... .......... .......... .......... 30% 119M 1s 2020-04-28T12:42:07.273 INFO:teuthology.orchestra.run.smithi197.stderr: 28150K .......... .......... .......... .......... .......... 30% 85.9M 1s 2020-04-28T12:42:07.273 INFO:teuthology.orchestra.run.smithi197.stderr: 28200K .......... .......... .......... .......... .......... 30% 120M 1s 2020-04-28T12:42:07.274 INFO:teuthology.orchestra.run.smithi197.stderr: 28250K .......... .......... .......... .......... .......... 30% 117M 1s 2020-04-28T12:42:07.274 INFO:teuthology.orchestra.run.smithi197.stderr: 28300K .......... .......... .......... .......... .......... 30% 108M 1s 2020-04-28T12:42:07.274 INFO:teuthology.orchestra.run.smithi197.stderr: 28350K .......... .......... .......... .......... .......... 30% 115M 1s 2020-04-28T12:42:07.274 INFO:teuthology.orchestra.run.smithi197.stderr: 28400K .......... .......... .......... .......... .......... 30% 116M 1s 2020-04-28T12:42:07.274 INFO:teuthology.orchestra.run.smithi197.stderr: 28450K .......... .......... .......... .......... .......... 30% 115M 1s 2020-04-28T12:42:07.274 INFO:teuthology.orchestra.run.smithi197.stderr: 28500K .......... .......... .......... .......... .......... 30% 118M 1s 2020-04-28T12:42:07.274 INFO:teuthology.orchestra.run.smithi197.stderr: 28550K .......... .......... .......... .......... .......... 30% 91.7M 1s 2020-04-28T12:42:07.275 INFO:teuthology.orchestra.run.smithi197.stderr: 28600K .......... .......... .......... .......... .......... 30% 115M 1s 2020-04-28T12:42:07.275 INFO:teuthology.orchestra.run.smithi197.stderr: 28650K .......... .......... .......... .......... .......... 30% 117M 1s 2020-04-28T12:42:07.275 INFO:teuthology.orchestra.run.smithi197.stderr: 28700K .......... .......... .......... .......... .......... 30% 117M 1s 2020-04-28T12:42:07.275 INFO:teuthology.orchestra.run.smithi197.stderr: 28750K .......... .......... .......... .......... .......... 31% 112M 1s 2020-04-28T12:42:07.275 INFO:teuthology.orchestra.run.smithi197.stderr: 28800K .......... .......... .......... .......... .......... 31% 121M 1s 2020-04-28T12:42:07.275 INFO:teuthology.orchestra.run.smithi197.stderr: 28850K .......... .......... .......... .......... .......... 31% 112M 1s 2020-04-28T12:42:07.276 INFO:teuthology.orchestra.run.smithi197.stderr: 28900K .......... .......... .......... .......... .......... 31% 114M 1s 2020-04-28T12:42:07.276 INFO:teuthology.orchestra.run.smithi197.stderr: 28950K .......... .......... .......... .......... .......... 31% 99.1M 1s 2020-04-28T12:42:07.276 INFO:teuthology.orchestra.run.smithi197.stderr: 29000K .......... .......... .......... .......... .......... 31% 98.7M 1s 2020-04-28T12:42:07.276 INFO:teuthology.orchestra.run.smithi197.stderr: 29050K .......... .......... .......... .......... .......... 31% 110M 1s 2020-04-28T12:42:07.276 INFO:teuthology.orchestra.run.smithi197.stderr: 29100K .......... .......... .......... .......... .......... 31% 118M 1s 2020-04-28T12:42:07.276 INFO:teuthology.orchestra.run.smithi197.stderr: 29150K .......... .......... .......... .......... .......... 31% 106M 1s 2020-04-28T12:42:07.277 INFO:teuthology.orchestra.run.smithi197.stderr: 29200K .......... .......... .......... .......... .......... 31% 114M 1s 2020-04-28T12:42:07.277 INFO:teuthology.orchestra.run.smithi197.stderr: 29250K .......... .......... .......... .......... .......... 31% 114M 1s 2020-04-28T12:42:07.277 INFO:teuthology.orchestra.run.smithi197.stderr: 29300K .......... .......... .......... .......... .......... 31% 116M 1s 2020-04-28T12:42:07.277 INFO:teuthology.orchestra.run.smithi197.stderr: 29350K .......... .......... .......... .......... .......... 31% 84.1M 1s 2020-04-28T12:42:07.277 INFO:teuthology.orchestra.run.smithi197.stderr: 29400K .......... .......... .......... .......... .......... 31% 111M 1s 2020-04-28T12:42:07.277 INFO:teuthology.orchestra.run.smithi197.stderr: 29450K .......... .......... .......... .......... .......... 31% 117M 1s 2020-04-28T12:42:07.277 INFO:teuthology.orchestra.run.smithi197.stderr: 29500K .......... .......... .......... .......... .......... 31% 117M 1s 2020-04-28T12:42:07.278 INFO:teuthology.orchestra.run.smithi197.stderr: 29550K .......... .......... .......... .......... .......... 31% 113M 1s 2020-04-28T12:42:07.278 INFO:teuthology.orchestra.run.smithi197.stderr: 29600K .......... .......... .......... .......... .......... 31% 118M 1s 2020-04-28T12:42:07.278 INFO:teuthology.orchestra.run.smithi197.stderr: 29650K .......... .......... .......... .......... .......... 31% 116M 1s 2020-04-28T12:42:07.278 INFO:teuthology.orchestra.run.smithi197.stderr: 29700K .......... .......... .......... .......... .......... 32% 117M 1s 2020-04-28T12:42:07.278 INFO:teuthology.orchestra.run.smithi197.stderr: 29750K .......... .......... .......... .......... .......... 32% 88.8M 1s 2020-04-28T12:42:07.278 INFO:teuthology.orchestra.run.smithi197.stderr: 29800K .......... .......... .......... .......... .......... 32% 115M 1s 2020-04-28T12:42:07.278 INFO:teuthology.orchestra.run.smithi197.stderr: 29850K .......... .......... .......... .......... .......... 32% 112M 1s 2020-04-28T12:42:07.279 INFO:teuthology.orchestra.run.smithi197.stderr: 29900K .......... .......... .......... .......... .......... 32% 110M 1s 2020-04-28T12:42:07.279 INFO:teuthology.orchestra.run.smithi197.stderr: 29950K .......... .......... .......... .......... .......... 32% 112M 1s 2020-04-28T12:42:07.279 INFO:teuthology.orchestra.run.smithi197.stderr: 30000K .......... .......... .......... .......... .......... 32% 109M 1s 2020-04-28T12:42:07.279 INFO:teuthology.orchestra.run.smithi197.stderr: 30050K .......... .......... .......... .......... .......... 32% 121M 1s 2020-04-28T12:42:07.279 INFO:teuthology.orchestra.run.smithi197.stderr: 30100K .......... .......... .......... .......... .......... 32% 110M 1s 2020-04-28T12:42:07.279 INFO:teuthology.orchestra.run.smithi197.stderr: 30150K .......... .......... .......... .......... .......... 32% 85.4M 1s 2020-04-28T12:42:07.279 INFO:teuthology.orchestra.run.smithi197.stderr: 30200K .......... .......... .......... .......... .......... 32% 123M 1s 2020-04-28T12:42:07.280 INFO:teuthology.orchestra.run.smithi197.stderr: 30250K .......... .......... .......... .......... .......... 32% 109M 1s 2020-04-28T12:42:07.280 INFO:teuthology.orchestra.run.smithi197.stderr: 30300K .......... .......... .......... .......... .......... 32% 107M 1s 2020-04-28T12:42:07.280 INFO:teuthology.orchestra.run.smithi197.stderr: 30350K .......... .......... .......... .......... .......... 32% 118M 1s 2020-04-28T12:42:07.280 INFO:teuthology.orchestra.run.smithi197.stderr: 30400K .......... .......... .......... .......... .......... 32% 116M 1s 2020-04-28T12:42:07.280 INFO:teuthology.orchestra.run.smithi197.stderr: 30450K .......... .......... .......... .......... .......... 32% 120M 1s 2020-04-28T12:42:07.280 INFO:teuthology.orchestra.run.smithi197.stderr: 30500K .......... .......... .......... .......... .......... 32% 113M 1s 2020-04-28T12:42:07.280 INFO:teuthology.orchestra.run.smithi197.stderr: 30550K .......... .......... .......... .......... .......... 32% 86.7M 1s 2020-04-28T12:42:07.281 INFO:teuthology.orchestra.run.smithi197.stderr: 30600K .......... .......... .......... .......... .......... 32% 116M 1s 2020-04-28T12:42:07.281 INFO:teuthology.orchestra.run.smithi197.stderr: 30650K .......... .......... .......... .......... .......... 33% 112M 1s 2020-04-28T12:42:07.281 INFO:teuthology.orchestra.run.smithi197.stderr: 30700K .......... .......... .......... .......... .......... 33% 117M 1s 2020-04-28T12:42:07.281 INFO:teuthology.orchestra.run.smithi197.stderr: 30750K .......... .......... .......... .......... .......... 33% 106M 1s 2020-04-28T12:42:07.281 INFO:teuthology.orchestra.run.smithi197.stderr: 30800K .......... .......... .......... .......... .......... 33% 87.8M 1s 2020-04-28T12:42:07.281 INFO:teuthology.orchestra.run.smithi197.stderr: 30850K .......... .......... .......... .......... .......... 33% 164M 1s 2020-04-28T12:42:07.281 INFO:teuthology.orchestra.run.smithi197.stderr: 30900K .......... .......... .......... .......... .......... 33% 114M 1s 2020-04-28T12:42:07.282 INFO:teuthology.orchestra.run.smithi197.stderr: 30950K .......... .......... .......... .......... .......... 33% 85.9M 1s 2020-04-28T12:42:07.282 INFO:teuthology.orchestra.run.smithi197.stderr: 31000K .......... .......... .......... .......... .......... 33% 117M 1s 2020-04-28T12:42:07.282 INFO:teuthology.orchestra.run.smithi197.stderr: 31050K .......... .......... .......... .......... .......... 33% 105M 1s 2020-04-28T12:42:07.282 INFO:teuthology.orchestra.run.smithi197.stderr: 31100K .......... .......... .......... .......... .......... 33% 111M 1s 2020-04-28T12:42:07.282 INFO:teuthology.orchestra.run.smithi197.stderr: 31150K .......... .......... .......... .......... .......... 33% 94.7M 1s 2020-04-28T12:42:07.282 INFO:teuthology.orchestra.run.smithi197.stderr: 31200K .......... .......... .......... .......... .......... 33% 141M 1s 2020-04-28T12:42:07.282 INFO:teuthology.orchestra.run.smithi197.stderr: 31250K .......... .......... .......... .......... .......... 33% 116M 1s 2020-04-28T12:42:07.283 INFO:teuthology.orchestra.run.smithi197.stderr: 31300K .......... .......... .......... .......... .......... 33% 118M 1s 2020-04-28T12:42:07.283 INFO:teuthology.orchestra.run.smithi197.stderr: 31350K .......... .......... .......... .......... .......... 33% 85.8M 1s 2020-04-28T12:42:07.283 INFO:teuthology.orchestra.run.smithi197.stderr: 31400K .......... .......... .......... .......... .......... 33% 112M 1s 2020-04-28T12:42:07.283 INFO:teuthology.orchestra.run.smithi197.stderr: 31450K .......... .......... .......... .......... .......... 33% 115M 1s 2020-04-28T12:42:07.283 INFO:teuthology.orchestra.run.smithi197.stderr: 31500K .......... .......... .......... .......... .......... 33% 110M 1s 2020-04-28T12:42:07.283 INFO:teuthology.orchestra.run.smithi197.stderr: 31550K .......... .......... .......... .......... .......... 34% 122M 1s 2020-04-28T12:42:07.283 INFO:teuthology.orchestra.run.smithi197.stderr: 31600K .......... .......... .......... .......... .......... 34% 110M 1s 2020-04-28T12:42:07.284 INFO:teuthology.orchestra.run.smithi197.stderr: 31650K .......... .......... .......... .......... .......... 34% 116M 1s 2020-04-28T12:42:07.284 INFO:teuthology.orchestra.run.smithi197.stderr: 31700K .......... .......... .......... .......... .......... 34% 116M 1s 2020-04-28T12:42:07.284 INFO:teuthology.orchestra.run.smithi197.stderr: 31750K .......... .......... .......... .......... .......... 34% 91.8M 1s 2020-04-28T12:42:07.284 INFO:teuthology.orchestra.run.smithi197.stderr: 31800K .......... .......... .......... .......... .......... 34% 118M 1s 2020-04-28T12:42:07.284 INFO:teuthology.orchestra.run.smithi197.stderr: 31850K .......... .......... .......... .......... .......... 34% 112M 1s 2020-04-28T12:42:07.284 INFO:teuthology.orchestra.run.smithi197.stderr: 31900K .......... .......... .......... .......... .......... 34% 117M 1s 2020-04-28T12:42:07.284 INFO:teuthology.orchestra.run.smithi197.stderr: 31950K .......... .......... .......... .......... .......... 34% 112M 1s 2020-04-28T12:42:07.285 INFO:teuthology.orchestra.run.smithi197.stderr: 32000K .......... .......... .......... .......... .......... 34% 110M 1s 2020-04-28T12:42:07.285 INFO:teuthology.orchestra.run.smithi197.stderr: 32050K .......... .......... .......... .......... .......... 34% 113M 1s 2020-04-28T12:42:07.285 INFO:teuthology.orchestra.run.smithi197.stderr: 32100K .......... .......... .......... .......... .......... 34% 117M 1s 2020-04-28T12:42:07.285 INFO:teuthology.orchestra.run.smithi197.stderr: 32150K .......... .......... .......... .......... .......... 34% 82.4M 1s 2020-04-28T12:42:07.285 INFO:teuthology.orchestra.run.smithi197.stderr: 32200K .......... .......... .......... .......... .......... 34% 113M 1s 2020-04-28T12:42:07.285 INFO:teuthology.orchestra.run.smithi197.stderr: 32250K .......... .......... .......... .......... .......... 34% 109M 1s 2020-04-28T12:42:07.285 INFO:teuthology.orchestra.run.smithi197.stderr: 32300K .......... .......... .......... .......... .......... 34% 130M 1s 2020-04-28T12:42:07.286 INFO:teuthology.orchestra.run.smithi197.stderr: 32350K .......... .......... .......... .......... .......... 34% 113M 1s 2020-04-28T12:42:07.286 INFO:teuthology.orchestra.run.smithi197.stderr: 32400K .......... .......... .......... .......... .......... 34% 113M 1s 2020-04-28T12:42:07.286 INFO:teuthology.orchestra.run.smithi197.stderr: 32450K .......... .......... .......... .......... .......... 34% 114M 1s 2020-04-28T12:42:07.286 INFO:teuthology.orchestra.run.smithi197.stderr: 32500K .......... .......... .......... .......... .......... 35% 121M 1s 2020-04-28T12:42:07.286 INFO:teuthology.orchestra.run.smithi197.stderr: 32550K .......... .......... .......... .......... .......... 35% 90.7M 1s 2020-04-28T12:42:07.286 INFO:teuthology.orchestra.run.smithi197.stderr: 32600K .......... .......... .......... .......... .......... 35% 117M 1s 2020-04-28T12:42:07.286 INFO:teuthology.orchestra.run.smithi197.stderr: 32650K .......... .......... .......... .......... .......... 35% 116M 1s 2020-04-28T12:42:07.287 INFO:teuthology.orchestra.run.smithi197.stderr: 32700K .......... .......... .......... .......... .......... 35% 120M 1s 2020-04-28T12:42:07.287 INFO:teuthology.orchestra.run.smithi197.stderr: 32750K .......... .......... .......... .......... .......... 35% 112M 1s 2020-04-28T12:42:07.287 INFO:teuthology.orchestra.run.smithi197.stderr: 32800K .......... .......... .......... .......... .......... 35% 116M 1s 2020-04-28T12:42:07.287 INFO:teuthology.orchestra.run.smithi197.stderr: 32850K .......... .......... .......... .......... .......... 35% 102M 1s 2020-04-28T12:42:07.287 INFO:teuthology.orchestra.run.smithi197.stderr: 32900K .......... .......... .......... .......... .......... 35% 116M 1s 2020-04-28T12:42:07.287 INFO:teuthology.orchestra.run.smithi197.stderr: 32950K .......... .......... .......... .......... .......... 35% 98.9M 1s 2020-04-28T12:42:07.287 INFO:teuthology.orchestra.run.smithi197.stderr: 33000K .......... .......... .......... .......... .......... 35% 115M 1s 2020-04-28T12:42:07.288 INFO:teuthology.orchestra.run.smithi197.stderr: 33050K .......... .......... .......... .......... .......... 35% 114M 1s 2020-04-28T12:42:07.288 INFO:teuthology.orchestra.run.smithi197.stderr: 33100K .......... .......... .......... .......... .......... 35% 116M 1s 2020-04-28T12:42:07.288 INFO:teuthology.orchestra.run.smithi197.stderr: 33150K .......... .......... .......... .......... .......... 35% 117M 1s 2020-04-28T12:42:07.288 INFO:teuthology.orchestra.run.smithi197.stderr: 33200K .......... .......... .......... .......... .......... 35% 115M 1s 2020-04-28T12:42:07.288 INFO:teuthology.orchestra.run.smithi197.stderr: 33250K .......... .......... .......... .......... .......... 35% 111M 1s 2020-04-28T12:42:07.288 INFO:teuthology.orchestra.run.smithi197.stderr: 33300K .......... .......... .......... .......... .......... 35% 110M 1s 2020-04-28T12:42:07.288 INFO:teuthology.orchestra.run.smithi197.stderr: 33350K .......... .......... .......... .......... .......... 35% 94.1M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33400K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33450K .......... .......... .......... .......... .......... 36% 116M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33500K .......... .......... .......... .......... .......... 36% 118M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33550K .......... .......... .......... .......... .......... 36% 105M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33600K .......... .......... .......... .......... .......... 36% 125M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33650K .......... .......... .......... .......... .......... 36% 81.5M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33700K .......... .......... .......... .......... .......... 36% 121M 1s 2020-04-28T12:42:07.289 INFO:teuthology.orchestra.run.smithi197.stderr: 33750K .......... .......... .......... .......... .......... 36% 89.3M 1s 2020-04-28T12:42:07.290 INFO:teuthology.orchestra.run.smithi197.stderr: 33800K .......... .......... .......... .......... .......... 36% 119M 1s 2020-04-28T12:42:07.290 INFO:teuthology.orchestra.run.smithi197.stderr: 33850K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T12:42:07.290 INFO:teuthology.orchestra.run.smithi197.stderr: 33900K .......... .......... .......... .......... .......... 36% 115M 1s 2020-04-28T12:42:07.290 INFO:teuthology.orchestra.run.smithi197.stderr: 33950K .......... .......... .......... .......... .......... 36% 114M 1s 2020-04-28T12:42:07.290 INFO:teuthology.orchestra.run.smithi197.stderr: 34000K .......... .......... .......... .......... .......... 36% 118M 1s 2020-04-28T12:42:07.290 INFO:teuthology.orchestra.run.smithi197.stderr: 34050K .......... .......... .......... .......... .......... 36% 107M 1s 2020-04-28T12:42:07.290 INFO:teuthology.orchestra.run.smithi197.stderr: 34100K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T12:42:07.291 INFO:teuthology.orchestra.run.smithi197.stderr: 34150K .......... .......... .......... .......... .......... 36% 88.9M 1s 2020-04-28T12:42:07.291 INFO:teuthology.orchestra.run.smithi197.stderr: 34200K .......... .......... .......... .......... .......... 36% 115M 1s 2020-04-28T12:42:07.291 INFO:teuthology.orchestra.run.smithi197.stderr: 34250K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T12:42:07.291 INFO:teuthology.orchestra.run.smithi197.stderr: 34300K .......... .......... .......... .......... .......... 36% 114M 1s 2020-04-28T12:42:07.291 INFO:teuthology.orchestra.run.smithi197.stderr: 34350K .......... .......... .......... .......... .......... 37% 100M 1s 2020-04-28T12:42:07.291 INFO:teuthology.orchestra.run.smithi197.stderr: 34400K .......... .......... .......... .......... .......... 37% 116M 1s 2020-04-28T12:42:07.291 INFO:teuthology.orchestra.run.smithi197.stderr: 34450K .......... .......... .......... .......... .......... 37% 118M 1s 2020-04-28T12:42:07.292 INFO:teuthology.orchestra.run.smithi197.stderr: 34500K .......... .......... .......... .......... .......... 37% 126M 1s 2020-04-28T12:42:07.292 INFO:teuthology.orchestra.run.smithi197.stderr: 34550K .......... .......... .......... .......... .......... 37% 89.3M 1s 2020-04-28T12:42:07.292 INFO:teuthology.orchestra.run.smithi197.stderr: 34600K .......... .......... .......... .......... .......... 37% 105M 1s 2020-04-28T12:42:07.292 INFO:teuthology.orchestra.run.smithi197.stderr: 34650K .......... .......... .......... .......... .......... 37% 107M 1s 2020-04-28T12:42:07.292 INFO:teuthology.orchestra.run.smithi197.stderr: 34700K .......... .......... .......... .......... .......... 37% 162M 1s 2020-04-28T12:42:07.292 INFO:teuthology.orchestra.run.smithi197.stderr: 34750K .......... .......... .......... .......... .......... 37% 89.2M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 34800K .......... .......... .......... .......... .......... 37% 138M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 34850K .......... .......... .......... .......... .......... 37% 115M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 34900K .......... .......... .......... .......... .......... 37% 107M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 34950K .......... .......... .......... .......... .......... 37% 93.1M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 35000K .......... .......... .......... .......... .......... 37% 133M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 35050K .......... .......... .......... .......... .......... 37% 122M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 35100K .......... .......... .......... .......... .......... 37% 114M 1s 2020-04-28T12:42:07.293 INFO:teuthology.orchestra.run.smithi197.stderr: 35150K .......... .......... .......... .......... .......... 37% 99.8M 1s 2020-04-28T12:42:07.294 INFO:teuthology.orchestra.run.smithi197.stderr: 35200K .......... .......... .......... .......... .......... 37% 119M 1s 2020-04-28T12:42:07.294 INFO:teuthology.orchestra.run.smithi197.stderr: 35250K .......... .......... .......... .......... .......... 37% 114M 1s 2020-04-28T12:42:07.294 INFO:teuthology.orchestra.run.smithi197.stderr: 35300K .......... .......... .......... .......... .......... 38% 115M 1s 2020-04-28T12:42:07.294 INFO:teuthology.orchestra.run.smithi197.stderr: 35350K .......... .......... .......... .......... .......... 38% 86.1M 1s 2020-04-28T12:42:07.294 INFO:teuthology.orchestra.run.smithi197.stderr: 35400K .......... .......... .......... .......... .......... 38% 118M 1s 2020-04-28T12:42:07.294 INFO:teuthology.orchestra.run.smithi197.stderr: 35450K .......... .......... .......... .......... .......... 38% 119M 1s 2020-04-28T12:42:07.295 INFO:teuthology.orchestra.run.smithi197.stderr: 35500K .......... .......... .......... .......... .......... 38% 117M 1s 2020-04-28T12:42:07.295 INFO:teuthology.orchestra.run.smithi197.stderr: 35550K .......... .......... .......... .......... .......... 38% 110M 1s 2020-04-28T12:42:07.295 INFO:teuthology.orchestra.run.smithi197.stderr: 35600K .......... .......... .......... .......... .......... 38% 115M 1s 2020-04-28T12:42:07.295 INFO:teuthology.orchestra.run.smithi197.stderr: 35650K .......... .......... .......... .......... .......... 38% 116M 1s 2020-04-28T12:42:07.295 INFO:teuthology.orchestra.run.smithi197.stderr: 35700K .......... .......... .......... .......... .......... 38% 113M 1s 2020-04-28T12:42:07.295 INFO:teuthology.orchestra.run.smithi197.stderr: 35750K .......... .......... .......... .......... .......... 38% 87.4M 1s 2020-04-28T12:42:07.295 INFO:teuthology.orchestra.run.smithi197.stderr: 35800K .......... .......... .......... .......... .......... 38% 118M 1s 2020-04-28T12:42:07.296 INFO:teuthology.orchestra.run.smithi197.stderr: 35850K .......... .......... .......... .......... .......... 38% 114M 1s 2020-04-28T12:42:07.296 INFO:teuthology.orchestra.run.smithi197.stderr: 35900K .......... .......... .......... .......... .......... 38% 117M 1s 2020-04-28T12:42:07.296 INFO:teuthology.orchestra.run.smithi197.stderr: 35950K .......... .......... .......... .......... .......... 38% 112M 1s 2020-04-28T12:42:07.296 INFO:teuthology.orchestra.run.smithi197.stderr: 36000K .......... .......... .......... .......... .......... 38% 112M 1s 2020-04-28T12:42:07.296 INFO:teuthology.orchestra.run.smithi197.stderr: 36050K .......... .......... .......... .......... .......... 38% 122M 1s 2020-04-28T12:42:07.296 INFO:teuthology.orchestra.run.smithi197.stderr: 36100K .......... .......... .......... .......... .......... 38% 115M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36150K .......... .......... .......... .......... .......... 38% 89.8M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36200K .......... .......... .......... .......... .......... 39% 115M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36250K .......... .......... .......... .......... .......... 39% 118M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36300K .......... .......... .......... .......... .......... 39% 116M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36350K .......... .......... .......... .......... .......... 39% 113M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36400K .......... .......... .......... .......... .......... 39% 102M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36450K .......... .......... .......... .......... .......... 39% 132M 1s 2020-04-28T12:42:07.297 INFO:teuthology.orchestra.run.smithi197.stderr: 36500K .......... .......... .......... .......... .......... 39% 116M 1s 2020-04-28T12:42:07.298 INFO:teuthology.orchestra.run.smithi197.stderr: 36550K .......... .......... .......... .......... .......... 39% 77.3M 1s 2020-04-28T12:42:07.298 INFO:teuthology.orchestra.run.smithi197.stderr: 36600K .......... .......... .......... .......... .......... 39% 119M 1s 2020-04-28T12:42:07.298 INFO:teuthology.orchestra.run.smithi197.stderr: 36650K .......... .......... .......... .......... .......... 39% 114M 1s 2020-04-28T12:42:07.298 INFO:teuthology.orchestra.run.smithi197.stderr: 36700K .......... .......... .......... .......... .......... 39% 109M 1s 2020-04-28T12:42:07.298 INFO:teuthology.orchestra.run.smithi197.stderr: 36750K .......... .......... .......... .......... .......... 39% 106M 1s 2020-04-28T12:42:07.298 INFO:teuthology.orchestra.run.smithi197.stderr: 36800K .......... .......... .......... .......... .......... 39% 104M 1s 2020-04-28T12:42:07.298 INFO:teuthology.orchestra.run.smithi197.stderr: 36850K .......... .......... .......... .......... .......... 39% 141M 1s 2020-04-28T12:42:07.299 INFO:teuthology.orchestra.run.smithi197.stderr: 36900K .......... .......... .......... .......... .......... 39% 121M 1s 2020-04-28T12:42:07.299 INFO:teuthology.orchestra.run.smithi197.stderr: 36950K .......... .......... .......... .......... .......... 39% 88.4M 1s 2020-04-28T12:42:07.299 INFO:teuthology.orchestra.run.smithi197.stderr: 37000K .......... .......... .......... .......... .......... 39% 112M 1s 2020-04-28T12:42:07.299 INFO:teuthology.orchestra.run.smithi197.stderr: 37050K .......... .......... .......... .......... .......... 39% 118M 1s 2020-04-28T12:42:07.299 INFO:teuthology.orchestra.run.smithi197.stderr: 37100K .......... .......... .......... .......... .......... 39% 118M 1s 2020-04-28T12:42:07.299 INFO:teuthology.orchestra.run.smithi197.stderr: 37150K .......... .......... .......... .......... .......... 40% 107M 1s 2020-04-28T12:42:07.299 INFO:teuthology.orchestra.run.smithi197.stderr: 37200K .......... .......... .......... .......... .......... 40% 112M 1s 2020-04-28T12:42:07.300 INFO:teuthology.orchestra.run.smithi197.stderr: 37250K .......... .......... .......... .......... .......... 40% 125M 1s 2020-04-28T12:42:07.300 INFO:teuthology.orchestra.run.smithi197.stderr: 37300K .......... .......... .......... .......... .......... 40% 116M 1s 2020-04-28T12:42:07.300 INFO:teuthology.orchestra.run.smithi197.stderr: 37350K .......... .......... .......... .......... .......... 40% 82.9M 1s 2020-04-28T12:42:07.300 INFO:teuthology.orchestra.run.smithi197.stderr: 37400K .......... .......... .......... .......... .......... 40% 131M 1s 2020-04-28T12:42:07.300 INFO:teuthology.orchestra.run.smithi197.stderr: 37450K .......... .......... .......... .......... .......... 40% 117M 1s 2020-04-28T12:42:07.300 INFO:teuthology.orchestra.run.smithi197.stderr: 37500K .......... .......... .......... .......... .......... 40% 107M 1s 2020-04-28T12:42:07.300 INFO:teuthology.orchestra.run.smithi197.stderr: 37550K .......... .......... .......... .......... .......... 40% 122M 1s 2020-04-28T12:42:07.301 INFO:teuthology.orchestra.run.smithi197.stderr: 37600K .......... .......... .......... .......... .......... 40% 115M 1s 2020-04-28T12:42:07.301 INFO:teuthology.orchestra.run.smithi197.stderr: 37650K .......... .......... .......... .......... .......... 40% 116M 1s 2020-04-28T12:42:07.301 INFO:teuthology.orchestra.run.smithi197.stderr: 37700K .......... .......... .......... .......... .......... 40% 117M 1s 2020-04-28T12:42:07.301 INFO:teuthology.orchestra.run.smithi197.stderr: 37750K .......... .......... .......... .......... .......... 40% 89.6M 1s 2020-04-28T12:42:07.301 INFO:teuthology.orchestra.run.smithi197.stderr: 37800K .......... .......... .......... .......... .......... 40% 117M 1s 2020-04-28T12:42:07.301 INFO:teuthology.orchestra.run.smithi197.stderr: 37850K .......... .......... .......... .......... .......... 40% 115M 1s 2020-04-28T12:42:07.301 INFO:teuthology.orchestra.run.smithi197.stderr: 37900K .......... .......... .......... .......... .......... 40% 116M 1s 2020-04-28T12:42:07.302 INFO:teuthology.orchestra.run.smithi197.stderr: 37950K .......... .......... .......... .......... .......... 40% 112M 1s 2020-04-28T12:42:07.302 INFO:teuthology.orchestra.run.smithi197.stderr: 38000K .......... .......... .......... .......... .......... 40% 116M 1s 2020-04-28T12:42:07.302 INFO:teuthology.orchestra.run.smithi197.stderr: 38050K .......... .......... .......... .......... .......... 41% 119M 1s 2020-04-28T12:42:07.302 INFO:teuthology.orchestra.run.smithi197.stderr: 38100K .......... .......... .......... .......... .......... 41% 113M 1s 2020-04-28T12:42:07.302 INFO:teuthology.orchestra.run.smithi197.stderr: 38150K .......... .......... .......... .......... .......... 41% 91.4M 1s 2020-04-28T12:42:07.302 INFO:teuthology.orchestra.run.smithi197.stderr: 38200K .......... .......... .......... .......... .......... 41% 118M 1s 2020-04-28T12:42:07.302 INFO:teuthology.orchestra.run.smithi197.stderr: 38250K .......... .......... .......... .......... .......... 41% 115M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38300K .......... .......... .......... .......... .......... 41% 117M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38350K .......... .......... .......... .......... .......... 41% 107M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38400K .......... .......... .......... .......... .......... 41% 107M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38450K .......... .......... .......... .......... .......... 41% 123M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38500K .......... .......... .......... .......... .......... 41% 123M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38550K .......... .......... .......... .......... .......... 41% 90.5M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38600K .......... .......... .......... .......... .......... 41% 109M 1s 2020-04-28T12:42:07.303 INFO:teuthology.orchestra.run.smithi197.stderr: 38650K .......... .......... .......... .......... .......... 41% 121M 1s 2020-04-28T12:42:07.304 INFO:teuthology.orchestra.run.smithi197.stderr: 38700K .......... .......... .......... .......... .......... 41% 111M 1s 2020-04-28T12:42:07.304 INFO:teuthology.orchestra.run.smithi197.stderr: 38750K .......... .......... .......... .......... .......... 41% 112M 1s 2020-04-28T12:42:07.304 INFO:teuthology.orchestra.run.smithi197.stderr: 38800K .......... .......... .......... .......... .......... 41% 117M 1s 2020-04-28T12:42:07.304 INFO:teuthology.orchestra.run.smithi197.stderr: 38850K .......... .......... .......... .......... .......... 41% 109M 1s 2020-04-28T12:42:07.304 INFO:teuthology.orchestra.run.smithi197.stderr: 38900K .......... .......... .......... .......... .......... 41% 122M 1s 2020-04-28T12:42:07.304 INFO:teuthology.orchestra.run.smithi197.stderr: 38950K .......... .......... .......... .......... .......... 41% 88.0M 1s 2020-04-28T12:42:07.304 INFO:teuthology.orchestra.run.smithi197.stderr: 39000K .......... .......... .......... .......... .......... 42% 114M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39050K .......... .......... .......... .......... .......... 42% 121M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39100K .......... .......... .......... .......... .......... 42% 114M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39150K .......... .......... .......... .......... .......... 42% 113M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39200K .......... .......... .......... .......... .......... 42% 114M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39250K .......... .......... .......... .......... .......... 42% 117M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39300K .......... .......... .......... .......... .......... 42% 115M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39350K .......... .......... .......... .......... .......... 42% 89.2M 1s 2020-04-28T12:42:07.305 INFO:teuthology.orchestra.run.smithi197.stderr: 39400K .......... .......... .......... .......... .......... 42% 116M 1s 2020-04-28T12:42:07.306 INFO:teuthology.orchestra.run.smithi197.stderr: 39450K .......... .......... .......... .......... .......... 42% 114M 1s 2020-04-28T12:42:07.306 INFO:teuthology.orchestra.run.smithi197.stderr: 39500K .......... .......... .......... .......... .......... 42% 122M 1s 2020-04-28T12:42:07.306 INFO:teuthology.orchestra.run.smithi197.stderr: 39550K .......... .......... .......... .......... .......... 42% 110M 1s 2020-04-28T12:42:07.306 INFO:teuthology.orchestra.run.smithi197.stderr: 39600K .......... .......... .......... .......... .......... 42% 108M 1s 2020-04-28T12:42:07.306 INFO:teuthology.orchestra.run.smithi197.stderr: 39650K .......... .......... .......... .......... .......... 42% 116M 1s 2020-04-28T12:42:07.306 INFO:teuthology.orchestra.run.smithi197.stderr: 39700K .......... .......... .......... .......... .......... 42% 118M 1s 2020-04-28T12:42:07.307 INFO:teuthology.orchestra.run.smithi197.stderr: 39750K .......... .......... .......... .......... .......... 42% 89.5M 1s 2020-04-28T12:42:07.307 INFO:teuthology.orchestra.run.smithi197.stderr: 39800K .......... .......... .......... .......... .......... 42% 117M 1s 2020-04-28T12:42:07.307 INFO:teuthology.orchestra.run.smithi197.stderr: 39850K .......... .......... .......... .......... .......... 42% 120M 1s 2020-04-28T12:42:07.307 INFO:teuthology.orchestra.run.smithi197.stderr: 39900K .......... .......... .......... .......... .......... 43% 113M 1s 2020-04-28T12:42:07.307 INFO:teuthology.orchestra.run.smithi197.stderr: 39950K .......... .......... .......... .......... .......... 43% 96.7M 1s 2020-04-28T12:42:07.307 INFO:teuthology.orchestra.run.smithi197.stderr: 40000K .......... .......... .......... .......... .......... 43% 139M 1s 2020-04-28T12:42:07.307 INFO:teuthology.orchestra.run.smithi197.stderr: 40050K .......... .......... .......... .......... .......... 43% 114M 1s 2020-04-28T12:42:07.308 INFO:teuthology.orchestra.run.smithi197.stderr: 40100K .......... .......... .......... .......... .......... 43% 114M 1s 2020-04-28T12:42:07.308 INFO:teuthology.orchestra.run.smithi197.stderr: 40150K .......... .......... .......... .......... .......... 43% 90.0M 1s 2020-04-28T12:42:07.308 INFO:teuthology.orchestra.run.smithi197.stderr: 40200K .......... .......... .......... .......... .......... 43% 113M 1s 2020-04-28T12:42:07.308 INFO:teuthology.orchestra.run.smithi197.stderr: 40250K .......... .......... .......... .......... .......... 43% 121M 1s 2020-04-28T12:42:07.308 INFO:teuthology.orchestra.run.smithi197.stderr: 40300K .......... .......... .......... .......... .......... 43% 113M 1s 2020-04-28T12:42:07.308 INFO:teuthology.orchestra.run.smithi197.stderr: 40350K .......... .......... .......... .......... .......... 43% 114M 1s 2020-04-28T12:42:07.308 INFO:teuthology.orchestra.run.smithi197.stderr: 40400K .......... .......... .......... .......... .......... 43% 115M 1s 2020-04-28T12:42:07.309 INFO:teuthology.orchestra.run.smithi197.stderr: 40450K .......... .......... .......... .......... .......... 43% 116M 1s 2020-04-28T12:42:07.309 INFO:teuthology.orchestra.run.smithi197.stderr: 40500K .......... .......... .......... .......... .......... 43% 119M 1s 2020-04-28T12:42:07.309 INFO:teuthology.orchestra.run.smithi197.stderr: 40550K .......... .......... .......... .......... .......... 43% 87.9M 1s 2020-04-28T12:42:07.309 INFO:teuthology.orchestra.run.smithi197.stderr: 40600K .......... .......... .......... .......... .......... 43% 118M 1s 2020-04-28T12:42:07.309 INFO:teuthology.orchestra.run.smithi197.stderr: 40650K .......... .......... .......... .......... .......... 43% 120M 1s 2020-04-28T12:42:07.309 INFO:teuthology.orchestra.run.smithi197.stderr: 40700K .......... .......... .......... .......... .......... 43% 114M 1s 2020-04-28T12:42:07.309 INFO:teuthology.orchestra.run.smithi197.stderr: 40750K .......... .......... .......... .......... .......... 43% 113M 1s 2020-04-28T12:42:07.310 INFO:teuthology.orchestra.run.smithi197.stderr: 40800K .......... .......... .......... .......... .......... 43% 110M 1s 2020-04-28T12:42:07.310 INFO:teuthology.orchestra.run.smithi197.stderr: 40850K .......... .......... .......... .......... .......... 44% 111M 1s 2020-04-28T12:42:07.310 INFO:teuthology.orchestra.run.smithi197.stderr: 40900K .......... .......... .......... .......... .......... 44% 116M 1s 2020-04-28T12:42:07.310 INFO:teuthology.orchestra.run.smithi197.stderr: 40950K .......... .......... .......... .......... .......... 44% 87.4M 1s 2020-04-28T12:42:07.310 INFO:teuthology.orchestra.run.smithi197.stderr: 41000K .......... .......... .......... .......... .......... 44% 112M 1s 2020-04-28T12:42:07.310 INFO:teuthology.orchestra.run.smithi197.stderr: 41050K .......... .......... .......... .......... .......... 44% 120M 1s 2020-04-28T12:42:07.310 INFO:teuthology.orchestra.run.smithi197.stderr: 41100K .......... .......... .......... .......... .......... 44% 112M 1s 2020-04-28T12:42:07.311 INFO:teuthology.orchestra.run.smithi197.stderr: 41150K .......... .......... .......... .......... .......... 44% 112M 1s 2020-04-28T12:42:07.311 INFO:teuthology.orchestra.run.smithi197.stderr: 41200K .......... .......... .......... .......... .......... 44% 118M 1s 2020-04-28T12:42:07.311 INFO:teuthology.orchestra.run.smithi197.stderr: 41250K .......... .......... .......... .......... .......... 44% 112M 1s 2020-04-28T12:42:07.311 INFO:teuthology.orchestra.run.smithi197.stderr: 41300K .......... .......... .......... .......... .......... 44% 121M 1s 2020-04-28T12:42:07.311 INFO:teuthology.orchestra.run.smithi197.stderr: 41350K .......... .......... .......... .......... .......... 44% 90.1M 1s 2020-04-28T12:42:07.311 INFO:teuthology.orchestra.run.smithi197.stderr: 41400K .......... .......... .......... .......... .......... 44% 113M 1s 2020-04-28T12:42:07.311 INFO:teuthology.orchestra.run.smithi197.stderr: 41450K .......... .......... .......... .......... .......... 44% 117M 1s 2020-04-28T12:42:07.312 INFO:teuthology.orchestra.run.smithi197.stderr: 41500K .......... .......... .......... .......... .......... 44% 113M 1s 2020-04-28T12:42:07.312 INFO:teuthology.orchestra.run.smithi197.stderr: 41550K .......... .......... .......... .......... .......... 44% 112M 1s 2020-04-28T12:42:07.312 INFO:teuthology.orchestra.run.smithi197.stderr: 41600K .......... .......... .......... .......... .......... 44% 121M 1s 2020-04-28T12:42:07.312 INFO:teuthology.orchestra.run.smithi197.stderr: 41650K .......... .......... .......... .......... .......... 44% 112M 1s 2020-04-28T12:42:07.312 INFO:teuthology.orchestra.run.smithi197.stderr: 41700K .......... .......... .......... .......... .......... 44% 110M 1s 2020-04-28T12:42:07.312 INFO:teuthology.orchestra.run.smithi197.stderr: 41750K .......... .......... .......... .......... .......... 44% 86.9M 1s 2020-04-28T12:42:07.312 INFO:teuthology.orchestra.run.smithi197.stderr: 41800K .......... .......... .......... .......... .......... 45% 133M 1s 2020-04-28T12:42:07.313 INFO:teuthology.orchestra.run.smithi197.stderr: 41850K .......... .......... .......... .......... .......... 45% 111M 1s 2020-04-28T12:42:07.313 INFO:teuthology.orchestra.run.smithi197.stderr: 41900K .......... .......... .......... .......... .......... 45% 112M 1s 2020-04-28T12:42:07.313 INFO:teuthology.orchestra.run.smithi197.stderr: 41950K .......... .......... .......... .......... .......... 45% 115M 1s 2020-04-28T12:42:07.313 INFO:teuthology.orchestra.run.smithi197.stderr: 42000K .......... .......... .......... .......... .......... 45% 114M 1s 2020-04-28T12:42:07.313 INFO:teuthology.orchestra.run.smithi197.stderr: 42050K .......... .......... .......... .......... .......... 45% 113M 1s 2020-04-28T12:42:07.313 INFO:teuthology.orchestra.run.smithi197.stderr: 42100K .......... .......... .......... .......... .......... 45% 111M 1s 2020-04-28T12:42:07.313 INFO:teuthology.orchestra.run.smithi197.stderr: 42150K .......... .......... .......... .......... .......... 45% 93.3M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42200K .......... .......... .......... .......... .......... 45% 112M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42250K .......... .......... .......... .......... .......... 45% 120M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42300K .......... .......... .......... .......... .......... 45% 111M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42350K .......... .......... .......... .......... .......... 45% 113M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42400K .......... .......... .......... .......... .......... 45% 119M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42450K .......... .......... .......... .......... .......... 45% 115M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42500K .......... .......... .......... .......... .......... 45% 115M 1s 2020-04-28T12:42:07.314 INFO:teuthology.orchestra.run.smithi197.stderr: 42550K .......... .......... .......... .......... .......... 45% 92.1M 1s 2020-04-28T12:42:07.315 INFO:teuthology.orchestra.run.smithi197.stderr: 42600K .......... .......... .......... .......... .......... 45% 110M 1s 2020-04-28T12:42:07.315 INFO:teuthology.orchestra.run.smithi197.stderr: 42650K .......... .......... .......... .......... .......... 45% 118M 1s 2020-04-28T12:42:07.315 INFO:teuthology.orchestra.run.smithi197.stderr: 42700K .......... .......... .......... .......... .......... 46% 115M 1s 2020-04-28T12:42:07.315 INFO:teuthology.orchestra.run.smithi197.stderr: 42750K .......... .......... .......... .......... .......... 46% 114M 1s 2020-04-28T12:42:07.315 INFO:teuthology.orchestra.run.smithi197.stderr: 42800K .......... .......... .......... .......... .......... 46% 114M 1s 2020-04-28T12:42:07.315 INFO:teuthology.orchestra.run.smithi197.stderr: 42850K .......... .......... .......... .......... .......... 46% 117M 1s 2020-04-28T12:42:07.315 INFO:teuthology.orchestra.run.smithi197.stderr: 42900K .......... .......... .......... .......... .......... 46% 113M 1s 2020-04-28T12:42:07.316 INFO:teuthology.orchestra.run.smithi197.stderr: 42950K .......... .......... .......... .......... .......... 46% 91.6M 1s 2020-04-28T12:42:07.316 INFO:teuthology.orchestra.run.smithi197.stderr: 43000K .......... .......... .......... .......... .......... 46% 114M 1s 2020-04-28T12:42:07.316 INFO:teuthology.orchestra.run.smithi197.stderr: 43050K .......... .......... .......... .......... .......... 46% 69.4M 1s 2020-04-28T12:42:07.316 INFO:teuthology.orchestra.run.smithi197.stderr: 43100K .......... .......... .......... .......... .......... 46% 61.3M 1s 2020-04-28T12:42:07.316 INFO:teuthology.orchestra.run.smithi197.stderr: 43150K .......... .......... .......... .......... .......... 46% 210M 1s 2020-04-28T12:42:07.316 INFO:teuthology.orchestra.run.smithi197.stderr: 43200K .......... .......... .......... .......... .......... 46% 224M 1s 2020-04-28T12:42:07.316 INFO:teuthology.orchestra.run.smithi197.stderr: 43250K .......... .......... .......... .......... .......... 46% 224M 1s 2020-04-28T12:42:07.317 INFO:teuthology.orchestra.run.smithi197.stderr: 43300K .......... .......... .......... .......... .......... 46% 141M 1s 2020-04-28T12:42:07.317 INFO:teuthology.orchestra.run.smithi197.stderr: 43350K .......... .......... .......... .......... .......... 46% 88.3M 1s 2020-04-28T12:42:07.317 INFO:teuthology.orchestra.run.smithi197.stderr: 43400K .......... .......... .......... .......... .......... 46% 117M 1s 2020-04-28T12:42:07.317 INFO:teuthology.orchestra.run.smithi197.stderr: 43450K .......... .......... .......... .......... .......... 46% 116M 1s 2020-04-28T12:42:07.317 INFO:teuthology.orchestra.run.smithi197.stderr: 43500K .......... .......... .......... .......... .......... 46% 115M 1s 2020-04-28T12:42:07.317 INFO:teuthology.orchestra.run.smithi197.stderr: 43550K .......... .......... .......... .......... .......... 46% 116M 1s 2020-04-28T12:42:07.317 INFO:teuthology.orchestra.run.smithi197.stderr: 43600K .......... .......... .......... .......... .......... 46% 117M 1s 2020-04-28T12:42:07.318 INFO:teuthology.orchestra.run.smithi197.stderr: 43650K .......... .......... .......... .......... .......... 47% 116M 1s 2020-04-28T12:42:07.318 INFO:teuthology.orchestra.run.smithi197.stderr: 43700K .......... .......... .......... .......... .......... 47% 117M 1s 2020-04-28T12:42:07.318 INFO:teuthology.orchestra.run.smithi197.stderr: 43750K .......... .......... .......... .......... .......... 47% 87.7M 1s 2020-04-28T12:42:07.318 INFO:teuthology.orchestra.run.smithi197.stderr: 43800K .......... .......... .......... .......... .......... 47% 121M 1s 2020-04-28T12:42:07.318 INFO:teuthology.orchestra.run.smithi197.stderr: 43850K .......... .......... .......... .......... .......... 47% 113M 1s 2020-04-28T12:42:07.318 INFO:teuthology.orchestra.run.smithi197.stderr: 43900K .......... .......... .......... .......... .......... 47% 111M 1s 2020-04-28T12:42:07.318 INFO:teuthology.orchestra.run.smithi197.stderr: 43950K .......... .......... .......... .......... .......... 47% 114M 1s 2020-04-28T12:42:07.319 INFO:teuthology.orchestra.run.smithi197.stderr: 44000K .......... .......... .......... .......... .......... 47% 110M 1s 2020-04-28T12:42:07.319 INFO:teuthology.orchestra.run.smithi197.stderr: 44050K .......... .......... .......... .......... .......... 47% 117M 1s 2020-04-28T12:42:07.319 INFO:teuthology.orchestra.run.smithi197.stderr: 44100K .......... .......... .......... .......... .......... 47% 117M 1s 2020-04-28T12:42:07.319 INFO:teuthology.orchestra.run.smithi197.stderr: 44150K .......... .......... .......... .......... .......... 47% 86.9M 1s 2020-04-28T12:42:07.319 INFO:teuthology.orchestra.run.smithi197.stderr: 44200K .......... .......... .......... .......... .......... 47% 125M 0s 2020-04-28T12:42:07.319 INFO:teuthology.orchestra.run.smithi197.stderr: 44250K .......... .......... .......... .......... .......... 47% 111M 0s 2020-04-28T12:42:07.319 INFO:teuthology.orchestra.run.smithi197.stderr: 44300K .......... .......... .......... .......... .......... 47% 114M 0s 2020-04-28T12:42:07.320 INFO:teuthology.orchestra.run.smithi197.stderr: 44350K .......... .......... .......... .......... .......... 47% 115M 0s 2020-04-28T12:42:07.320 INFO:teuthology.orchestra.run.smithi197.stderr: 44400K .......... .......... .......... .......... .......... 47% 112M 0s 2020-04-28T12:42:07.320 INFO:teuthology.orchestra.run.smithi197.stderr: 44450K .......... .......... .......... .......... .......... 47% 117M 0s 2020-04-28T12:42:07.320 INFO:teuthology.orchestra.run.smithi197.stderr: 44500K .......... .......... .......... .......... .......... 47% 119M 0s 2020-04-28T12:42:07.320 INFO:teuthology.orchestra.run.smithi197.stderr: 44550K .......... .......... .......... .......... .......... 48% 89.2M 0s 2020-04-28T12:42:07.320 INFO:teuthology.orchestra.run.smithi197.stderr: 44600K .......... .......... .......... .......... .......... 48% 118M 0s 2020-04-28T12:42:07.320 INFO:teuthology.orchestra.run.smithi197.stderr: 44650K .......... .......... .......... .......... .......... 48% 118M 0s 2020-04-28T12:42:07.321 INFO:teuthology.orchestra.run.smithi197.stderr: 44700K .......... .......... .......... .......... .......... 48% 112M 0s 2020-04-28T12:42:07.321 INFO:teuthology.orchestra.run.smithi197.stderr: 44750K .......... .......... .......... .......... .......... 48% 114M 0s 2020-04-28T12:42:07.321 INFO:teuthology.orchestra.run.smithi197.stderr: 44800K .......... .......... .......... .......... .......... 48% 111M 0s 2020-04-28T12:42:07.321 INFO:teuthology.orchestra.run.smithi197.stderr: 44850K .......... .......... .......... .......... .......... 48% 119M 0s 2020-04-28T12:42:07.321 INFO:teuthology.orchestra.run.smithi197.stderr: 44900K .......... .......... .......... .......... .......... 48% 116M 0s 2020-04-28T12:42:07.321 INFO:teuthology.orchestra.run.smithi197.stderr: 44950K .......... .......... .......... .......... .......... 48% 86.4M 0s 2020-04-28T12:42:07.321 INFO:teuthology.orchestra.run.smithi197.stderr: 45000K .......... .......... .......... .......... .......... 48% 138M 0s 2020-04-28T12:42:07.322 INFO:teuthology.orchestra.run.smithi197.stderr: 45050K .......... .......... .......... .......... .......... 48% 99.4M 0s 2020-04-28T12:42:07.322 INFO:teuthology.orchestra.run.smithi197.stderr: 45100K .......... .......... .......... .......... .......... 48% 94.3M 0s 2020-04-28T12:42:07.322 INFO:teuthology.orchestra.run.smithi197.stderr: 45150K .......... .......... .......... .......... .......... 48% 104M 0s 2020-04-28T12:42:07.322 INFO:teuthology.orchestra.run.smithi197.stderr: 45200K .......... .......... .......... .......... .......... 48% 122M 0s 2020-04-28T12:42:07.322 INFO:teuthology.orchestra.run.smithi197.stderr: 45250K .......... .......... .......... .......... .......... 48% 105M 0s 2020-04-28T12:42:07.322 INFO:teuthology.orchestra.run.smithi197.stderr: 45300K .......... .......... .......... .......... .......... 48% 111M 0s 2020-04-28T12:42:07.322 INFO:teuthology.orchestra.run.smithi197.stderr: 45350K .......... .......... .......... .......... .......... 48% 109M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45400K .......... .......... .......... .......... .......... 48% 125M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45450K .......... .......... .......... .......... .......... 48% 111M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45500K .......... .......... .......... .......... .......... 49% 111M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45550K .......... .......... .......... .......... .......... 49% 89.7M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45600K .......... .......... .......... .......... .......... 49% 115M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45650K .......... .......... .......... .......... .......... 49% 116M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45700K .......... .......... .......... .......... .......... 49% 110M 0s 2020-04-28T12:42:07.323 INFO:teuthology.orchestra.run.smithi197.stderr: 45750K .......... .......... .......... .......... .......... 49% 117M 0s 2020-04-28T12:42:07.324 INFO:teuthology.orchestra.run.smithi197.stderr: 45800K .......... .......... .......... .......... .......... 49% 106M 0s 2020-04-28T12:42:07.324 INFO:teuthology.orchestra.run.smithi197.stderr: 45850K .......... .......... .......... .......... .......... 49% 120M 0s 2020-04-28T12:42:07.324 INFO:teuthology.orchestra.run.smithi197.stderr: 45900K .......... .......... .......... .......... .......... 49% 109M 0s 2020-04-28T12:42:07.324 INFO:teuthology.orchestra.run.smithi197.stderr: 45950K .......... .......... .......... .......... .......... 49% 88.0M 0s 2020-04-28T12:42:07.324 INFO:teuthology.orchestra.run.smithi197.stderr: 46000K .......... .......... .......... .......... .......... 49% 108M 0s 2020-04-28T12:42:07.324 INFO:teuthology.orchestra.run.smithi197.stderr: 46050K .......... .......... .......... .......... .......... 49% 116M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46100K .......... .......... .......... .......... .......... 49% 113M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46150K .......... .......... .......... .......... .......... 49% 115M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46200K .......... .......... .......... .......... .......... 49% 110M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46250K .......... .......... .......... .......... .......... 49% 118M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46300K .......... .......... .......... .......... .......... 49% 108M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46350K .......... .......... .......... .......... .......... 49% 91.8M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46400K .......... .......... .......... .......... .......... 49% 109M 0s 2020-04-28T12:42:07.325 INFO:teuthology.orchestra.run.smithi197.stderr: 46450K .......... .......... .......... .......... .......... 50% 113M 0s 2020-04-28T12:42:07.326 INFO:teuthology.orchestra.run.smithi197.stderr: 46500K .......... .......... .......... .......... .......... 50% 113M 0s 2020-04-28T12:42:07.326 INFO:teuthology.orchestra.run.smithi197.stderr: 46550K .......... .......... .......... .......... .......... 50% 116M 0s 2020-04-28T12:42:07.326 INFO:teuthology.orchestra.run.smithi197.stderr: 46600K .......... .......... .......... .......... .......... 50% 117M 0s 2020-04-28T12:42:07.326 INFO:teuthology.orchestra.run.smithi197.stderr: 46650K .......... .......... .......... .......... .......... 50% 118M 0s 2020-04-28T12:42:07.326 INFO:teuthology.orchestra.run.smithi197.stderr: 46700K .......... .......... .......... .......... .......... 50% 105M 0s 2020-04-28T12:42:07.326 INFO:teuthology.orchestra.run.smithi197.stderr: 46750K .......... .......... .......... .......... .......... 50% 91.6M 0s 2020-04-28T12:42:07.326 INFO:teuthology.orchestra.run.smithi197.stderr: 46800K .......... .......... .......... .......... .......... 50% 112M 0s 2020-04-28T12:42:07.327 INFO:teuthology.orchestra.run.smithi197.stderr: 46850K .......... .......... .......... .......... .......... 50% 116M 0s 2020-04-28T12:42:07.327 INFO:teuthology.orchestra.run.smithi197.stderr: 46900K .......... .......... .......... .......... .......... 50% 120M 0s 2020-04-28T12:42:07.327 INFO:teuthology.orchestra.run.smithi197.stderr: 46950K .......... .......... .......... .......... .......... 50% 111M 0s 2020-04-28T12:42:07.327 INFO:teuthology.orchestra.run.smithi197.stderr: 47000K .......... .......... .......... .......... .......... 50% 115M 0s 2020-04-28T12:42:07.327 INFO:teuthology.orchestra.run.smithi197.stderr: 47050K .......... .......... .......... .......... .......... 50% 117M 0s 2020-04-28T12:42:07.327 INFO:teuthology.orchestra.run.smithi197.stderr: 47100K .......... .......... .......... .......... .......... 50% 122M 0s 2020-04-28T12:42:07.327 INFO:teuthology.orchestra.run.smithi197.stderr: 47150K .......... .......... .......... .......... .......... 50% 87.7M 0s 2020-04-28T12:42:07.328 INFO:teuthology.orchestra.run.smithi197.stderr: 47200K .......... .......... .......... .......... .......... 50% 112M 0s 2020-04-28T12:42:07.328 INFO:teuthology.orchestra.run.smithi197.stderr: 47250K .......... .......... .......... .......... .......... 50% 118M 0s 2020-04-28T12:42:07.328 INFO:teuthology.orchestra.run.smithi197.stderr: 47300K .......... .......... .......... .......... .......... 50% 114M 0s 2020-04-28T12:42:07.328 INFO:teuthology.orchestra.run.smithi197.stderr: 47350K .......... .......... .......... .......... .......... 51% 114M 0s 2020-04-28T12:42:07.328 INFO:teuthology.orchestra.run.smithi197.stderr: 47400K .......... .......... .......... .......... .......... 51% 121M 0s 2020-04-28T12:42:07.328 INFO:teuthology.orchestra.run.smithi197.stderr: 47450K .......... .......... .......... .......... .......... 51% 113M 0s 2020-04-28T12:42:07.328 INFO:teuthology.orchestra.run.smithi197.stderr: 47500K .......... .......... .......... .......... .......... 51% 118M 0s 2020-04-28T12:42:07.329 INFO:teuthology.orchestra.run.smithi197.stderr: 47550K .......... .......... .......... .......... .......... 51% 83.0M 0s 2020-04-28T12:42:07.329 INFO:teuthology.orchestra.run.smithi197.stderr: 47600K .......... .......... .......... .......... .......... 51% 115M 0s 2020-04-28T12:42:07.329 INFO:teuthology.orchestra.run.smithi197.stderr: 47650K .......... .......... .......... .......... .......... 51% 99.4M 0s 2020-04-28T12:42:07.329 INFO:teuthology.orchestra.run.smithi197.stderr: 47700K .......... .......... .......... .......... .......... 51% 129M 0s 2020-04-28T12:42:07.329 INFO:teuthology.orchestra.run.smithi197.stderr: 47750K .......... .......... .......... .......... .......... 51% 120M 0s 2020-04-28T12:42:07.329 INFO:teuthology.orchestra.run.smithi197.stderr: 47800K .......... .......... .......... .......... .......... 51% 119M 0s 2020-04-28T12:42:07.329 INFO:teuthology.orchestra.run.smithi197.stderr: 47850K .......... .......... .......... .......... .......... 51% 113M 0s 2020-04-28T12:42:07.330 INFO:teuthology.orchestra.run.smithi197.stderr: 47900K .......... .......... .......... .......... .......... 51% 115M 0s 2020-04-28T12:42:07.330 INFO:teuthology.orchestra.run.smithi197.stderr: 47950K .......... .......... .......... .......... .......... 51% 90.6M 0s 2020-04-28T12:42:07.330 INFO:teuthology.orchestra.run.smithi197.stderr: 48000K .......... .......... .......... .......... .......... 51% 117M 0s 2020-04-28T12:42:07.330 INFO:teuthology.orchestra.run.smithi197.stderr: 48050K .......... .......... .......... .......... .......... 51% 113M 0s 2020-04-28T12:42:07.330 INFO:teuthology.orchestra.run.smithi197.stderr: 48100K .......... .......... .......... .......... .......... 51% 120M 0s 2020-04-28T12:42:07.330 INFO:teuthology.orchestra.run.smithi197.stderr: 48150K .......... .......... .......... .......... .......... 51% 111M 0s 2020-04-28T12:42:07.330 INFO:teuthology.orchestra.run.smithi197.stderr: 48200K .......... .......... .......... .......... .......... 51% 111M 0s 2020-04-28T12:42:07.331 INFO:teuthology.orchestra.run.smithi197.stderr: 48250K .......... .......... .......... .......... .......... 51% 110M 0s 2020-04-28T12:42:07.331 INFO:teuthology.orchestra.run.smithi197.stderr: 48300K .......... .......... .......... .......... .......... 52% 127M 0s 2020-04-28T12:42:07.331 INFO:teuthology.orchestra.run.smithi197.stderr: 48350K .......... .......... .......... .......... .......... 52% 84.0M 0s 2020-04-28T12:42:07.331 INFO:teuthology.orchestra.run.smithi197.stderr: 48400K .......... .......... .......... .......... .......... 52% 98.6M 0s 2020-04-28T12:42:07.331 INFO:teuthology.orchestra.run.smithi197.stderr: 48450K .......... .......... .......... .......... .......... 52% 115M 0s 2020-04-28T12:42:07.331 INFO:teuthology.orchestra.run.smithi197.stderr: 48500K .......... .......... .......... .......... .......... 52% 117M 0s 2020-04-28T12:42:07.331 INFO:teuthology.orchestra.run.smithi197.stderr: 48550K .......... .......... .......... .......... .......... 52% 111M 0s 2020-04-28T12:42:07.332 INFO:teuthology.orchestra.run.smithi197.stderr: 48600K .......... .......... .......... .......... .......... 52% 109M 0s 2020-04-28T12:42:07.332 INFO:teuthology.orchestra.run.smithi197.stderr: 48650K .......... .......... .......... .......... .......... 52% 113M 0s 2020-04-28T12:42:07.332 INFO:teuthology.orchestra.run.smithi197.stderr: 48700K .......... .......... .......... .......... .......... 52% 119M 0s 2020-04-28T12:42:07.332 INFO:teuthology.orchestra.run.smithi197.stderr: 48750K .......... .......... .......... .......... .......... 52% 87.4M 0s 2020-04-28T12:42:07.332 INFO:teuthology.orchestra.run.smithi197.stderr: 48800K .......... .......... .......... .......... .......... 52% 116M 0s 2020-04-28T12:42:07.332 INFO:teuthology.orchestra.run.smithi197.stderr: 48850K .......... .......... .......... .......... .......... 52% 116M 0s 2020-04-28T12:42:07.332 INFO:teuthology.orchestra.run.smithi197.stderr: 48900K .......... .......... .......... .......... .......... 52% 107M 0s 2020-04-28T12:42:07.333 INFO:teuthology.orchestra.run.smithi197.stderr: 48950K .......... .......... .......... .......... .......... 52% 116M 0s 2020-04-28T12:42:07.333 INFO:teuthology.orchestra.run.smithi197.stderr: 49000K .......... .......... .......... .......... .......... 52% 120M 0s 2020-04-28T12:42:07.333 INFO:teuthology.orchestra.run.smithi197.stderr: 49050K .......... .......... .......... .......... .......... 52% 114M 0s 2020-04-28T12:42:07.333 INFO:teuthology.orchestra.run.smithi197.stderr: 49100K .......... .......... .......... .......... .......... 52% 115M 0s 2020-04-28T12:42:07.333 INFO:teuthology.orchestra.run.smithi197.stderr: 49150K .......... .......... .......... .......... .......... 52% 87.2M 0s 2020-04-28T12:42:07.333 INFO:teuthology.orchestra.run.smithi197.stderr: 49200K .......... .......... .......... .......... .......... 53% 116M 0s 2020-04-28T12:42:07.333 INFO:teuthology.orchestra.run.smithi197.stderr: 49250K .......... .......... .......... .......... .......... 53% 116M 0s 2020-04-28T12:42:07.334 INFO:teuthology.orchestra.run.smithi197.stderr: 49300K .......... .......... .......... .......... .......... 53% 113M 0s 2020-04-28T12:42:07.334 INFO:teuthology.orchestra.run.smithi197.stderr: 49350K .......... .......... .......... .......... .......... 53% 113M 0s 2020-04-28T12:42:07.334 INFO:teuthology.orchestra.run.smithi197.stderr: 49400K .......... .......... .......... .......... .......... 53% 115M 0s 2020-04-28T12:42:07.334 INFO:teuthology.orchestra.run.smithi197.stderr: 49450K .......... .......... .......... .......... .......... 53% 117M 0s 2020-04-28T12:42:07.334 INFO:teuthology.orchestra.run.smithi197.stderr: 49500K .......... .......... .......... .......... .......... 53% 119M 0s 2020-04-28T12:42:07.334 INFO:teuthology.orchestra.run.smithi197.stderr: 49550K .......... .......... .......... .......... .......... 53% 82.8M 0s 2020-04-28T12:42:07.334 INFO:teuthology.orchestra.run.smithi197.stderr: 49600K .......... .......... .......... .......... .......... 53% 110M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 49650K .......... .......... .......... .......... .......... 53% 135M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 49700K .......... .......... .......... .......... .......... 53% 114M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 49750K .......... .......... .......... .......... .......... 53% 84.2M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 49800K .......... .......... .......... .......... .......... 53% 118M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 49850K .......... .......... .......... .......... .......... 53% 120M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 49900K .......... .......... .......... .......... .......... 53% 109M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 49950K .......... .......... .......... .......... .......... 53% 89.4M 0s 2020-04-28T12:42:07.335 INFO:teuthology.orchestra.run.smithi197.stderr: 50000K .......... .......... .......... .......... .......... 53% 112M 0s 2020-04-28T12:42:07.336 INFO:teuthology.orchestra.run.smithi197.stderr: 50050K .......... .......... .......... .......... .......... 53% 114M 0s 2020-04-28T12:42:07.336 INFO:teuthology.orchestra.run.smithi197.stderr: 50100K .......... .......... .......... .......... .......... 53% 119M 0s 2020-04-28T12:42:07.336 INFO:teuthology.orchestra.run.smithi197.stderr: 50150K .......... .......... .......... .......... .......... 54% 105M 0s 2020-04-28T12:42:07.336 INFO:teuthology.orchestra.run.smithi197.stderr: 50200K .......... .......... .......... .......... .......... 54% 120M 0s 2020-04-28T12:42:07.336 INFO:teuthology.orchestra.run.smithi197.stderr: 50250K .......... .......... .......... .......... .......... 54% 109M 0s 2020-04-28T12:42:07.336 INFO:teuthology.orchestra.run.smithi197.stderr: 50300K .......... .......... .......... .......... .......... 54% 117M 0s 2020-04-28T12:42:07.337 INFO:teuthology.orchestra.run.smithi197.stderr: 50350K .......... .......... .......... .......... .......... 54% 90.2M 0s 2020-04-28T12:42:07.337 INFO:teuthology.orchestra.run.smithi197.stderr: 50400K .......... .......... .......... .......... .......... 54% 118M 0s 2020-04-28T12:42:07.337 INFO:teuthology.orchestra.run.smithi197.stderr: 50450K .......... .......... .......... .......... .......... 54% 115M 0s 2020-04-28T12:42:07.337 INFO:teuthology.orchestra.run.smithi197.stderr: 50500K .......... .......... .......... .......... .......... 54% 112M 0s 2020-04-28T12:42:07.338 INFO:teuthology.orchestra.run.smithi197.stderr: 50550K .......... .......... .......... .......... .......... 54% 108M 0s 2020-04-28T12:42:07.338 INFO:teuthology.orchestra.run.smithi197.stderr: 50600K .......... .......... .......... .......... .......... 54% 114M 0s 2020-04-28T12:42:07.338 INFO:teuthology.orchestra.run.smithi197.stderr: 50650K .......... .......... .......... .......... .......... 54% 113M 0s 2020-04-28T12:42:07.338 INFO:teuthology.orchestra.run.smithi197.stderr: 50700K .......... .......... .......... .......... .......... 54% 125M 0s 2020-04-28T12:42:07.338 INFO:teuthology.orchestra.run.smithi197.stderr: 50750K .......... .......... .......... .......... .......... 54% 86.9M 0s 2020-04-28T12:42:07.338 INFO:teuthology.orchestra.run.smithi197.stderr: 50800K .......... .......... .......... .......... .......... 54% 117M 0s 2020-04-28T12:42:07.339 INFO:teuthology.orchestra.run.smithi197.stderr: 50850K .......... .......... .......... .......... .......... 54% 117M 0s 2020-04-28T12:42:07.339 INFO:teuthology.orchestra.run.smithi197.stderr: 50900K .......... .......... .......... .......... .......... 54% 117M 0s 2020-04-28T12:42:07.339 INFO:teuthology.orchestra.run.smithi197.stderr: 50950K .......... .......... .......... .......... .......... 54% 112M 0s 2020-04-28T12:42:07.339 INFO:teuthology.orchestra.run.smithi197.stderr: 51000K .......... .......... .......... .......... .......... 54% 107M 0s 2020-04-28T12:42:07.339 INFO:teuthology.orchestra.run.smithi197.stderr: 51050K .......... .......... .......... .......... .......... 55% 124M 0s 2020-04-28T12:42:07.339 INFO:teuthology.orchestra.run.smithi197.stderr: 51100K .......... .......... .......... .......... .......... 55% 115M 0s 2020-04-28T12:42:07.339 INFO:teuthology.orchestra.run.smithi197.stderr: 51150K .......... .......... .......... .......... .......... 55% 90.3M 0s 2020-04-28T12:42:07.340 INFO:teuthology.orchestra.run.smithi197.stderr: 51200K .......... .......... .......... .......... .......... 55% 117M 0s 2020-04-28T12:42:07.340 INFO:teuthology.orchestra.run.smithi197.stderr: 51250K .......... .......... .......... .......... .......... 55% 114M 0s 2020-04-28T12:42:07.340 INFO:teuthology.orchestra.run.smithi197.stderr: 51300K .......... .......... .......... .......... .......... 55% 119M 0s 2020-04-28T12:42:07.340 INFO:teuthology.orchestra.run.smithi197.stderr: 51350K .......... .......... .......... .......... .......... 55% 115M 0s 2020-04-28T12:42:07.340 INFO:teuthology.orchestra.run.smithi197.stderr: 51400K .......... .......... .......... .......... .......... 55% 112M 0s 2020-04-28T12:42:07.340 INFO:teuthology.orchestra.run.smithi197.stderr: 51450K .......... .......... .......... .......... .......... 55% 114M 0s 2020-04-28T12:42:07.340 INFO:teuthology.orchestra.run.smithi197.stderr: 51500K .......... .......... .......... .......... .......... 55% 116M 0s 2020-04-28T12:42:07.341 INFO:teuthology.orchestra.run.smithi197.stderr: 51550K .......... .......... .......... .......... .......... 55% 91.3M 0s 2020-04-28T12:42:07.341 INFO:teuthology.orchestra.run.smithi197.stderr: 51600K .......... .......... .......... .......... .......... 55% 115M 0s 2020-04-28T12:42:07.341 INFO:teuthology.orchestra.run.smithi197.stderr: 51650K .......... .......... .......... .......... .......... 55% 119M 0s 2020-04-28T12:42:07.341 INFO:teuthology.orchestra.run.smithi197.stderr: 51700K .......... .......... .......... .......... .......... 55% 112M 0s 2020-04-28T12:42:07.341 INFO:teuthology.orchestra.run.smithi197.stderr: 51750K .......... .......... .......... .......... .......... 55% 120M 0s 2020-04-28T12:42:07.341 INFO:teuthology.orchestra.run.smithi197.stderr: 51800K .......... .......... .......... .......... .......... 55% 113M 0s 2020-04-28T12:42:07.341 INFO:teuthology.orchestra.run.smithi197.stderr: 51850K .......... .......... .......... .......... .......... 55% 114M 0s 2020-04-28T12:42:07.342 INFO:teuthology.orchestra.run.smithi197.stderr: 51900K .......... .......... .......... .......... .......... 55% 117M 0s 2020-04-28T12:42:07.342 INFO:teuthology.orchestra.run.smithi197.stderr: 51950K .......... .......... .......... .......... .......... 55% 88.6M 0s 2020-04-28T12:42:07.342 INFO:teuthology.orchestra.run.smithi197.stderr: 52000K .......... .......... .......... .......... .......... 56% 118M 0s 2020-04-28T12:42:07.342 INFO:teuthology.orchestra.run.smithi197.stderr: 52050K .......... .......... .......... .......... .......... 56% 119M 0s 2020-04-28T12:42:07.342 INFO:teuthology.orchestra.run.smithi197.stderr: 52100K .......... .......... .......... .......... .......... 56% 115M 0s 2020-04-28T12:42:07.342 INFO:teuthology.orchestra.run.smithi197.stderr: 52150K .......... .......... .......... .......... .......... 56% 111M 0s 2020-04-28T12:42:07.342 INFO:teuthology.orchestra.run.smithi197.stderr: 52200K .......... .......... .......... .......... .......... 56% 111M 0s 2020-04-28T12:42:07.343 INFO:teuthology.orchestra.run.smithi197.stderr: 52250K .......... .......... .......... .......... .......... 56% 117M 0s 2020-04-28T12:42:07.343 INFO:teuthology.orchestra.run.smithi197.stderr: 52300K .......... .......... .......... .......... .......... 56% 118M 0s 2020-04-28T12:42:07.343 INFO:teuthology.orchestra.run.smithi197.stderr: 52350K .......... .......... .......... .......... .......... 56% 86.8M 0s 2020-04-28T12:42:07.343 INFO:teuthology.orchestra.run.smithi197.stderr: 52400K .......... .......... .......... .......... .......... 56% 119M 0s 2020-04-28T12:42:07.343 INFO:teuthology.orchestra.run.smithi197.stderr: 52450K .......... .......... .......... .......... .......... 56% 117M 0s 2020-04-28T12:42:07.343 INFO:teuthology.orchestra.run.smithi197.stderr: 52500K .......... .......... .......... .......... .......... 56% 118M 0s 2020-04-28T12:42:07.343 INFO:teuthology.orchestra.run.smithi197.stderr: 52550K .......... .......... .......... .......... .......... 56% 116M 0s 2020-04-28T12:42:07.344 INFO:teuthology.orchestra.run.smithi197.stderr: 52600K .......... .......... .......... .......... .......... 56% 115M 0s 2020-04-28T12:42:07.344 INFO:teuthology.orchestra.run.smithi197.stderr: 52650K .......... .......... .......... .......... .......... 56% 107M 0s 2020-04-28T12:42:07.344 INFO:teuthology.orchestra.run.smithi197.stderr: 52700K .......... .......... .......... .......... .......... 56% 116M 0s 2020-04-28T12:42:07.344 INFO:teuthology.orchestra.run.smithi197.stderr: 52750K .......... .......... .......... .......... .......... 56% 90.5M 0s 2020-04-28T12:42:07.344 INFO:teuthology.orchestra.run.smithi197.stderr: 52800K .......... .......... .......... .......... .......... 56% 117M 0s 2020-04-28T12:42:07.344 INFO:teuthology.orchestra.run.smithi197.stderr: 52850K .......... .......... .......... .......... .......... 56% 113M 0s 2020-04-28T12:42:07.344 INFO:teuthology.orchestra.run.smithi197.stderr: 52900K .......... .......... .......... .......... .......... 56% 117M 0s 2020-04-28T12:42:07.345 INFO:teuthology.orchestra.run.smithi197.stderr: 52950K .......... .......... .......... .......... .......... 57% 104M 0s 2020-04-28T12:42:07.345 INFO:teuthology.orchestra.run.smithi197.stderr: 53000K .......... .......... .......... .......... .......... 57% 120M 0s 2020-04-28T12:42:07.345 INFO:teuthology.orchestra.run.smithi197.stderr: 53050K .......... .......... .......... .......... .......... 57% 117M 0s 2020-04-28T12:42:07.345 INFO:teuthology.orchestra.run.smithi197.stderr: 53100K .......... .......... .......... .......... .......... 57% 113M 0s 2020-04-28T12:42:07.345 INFO:teuthology.orchestra.run.smithi197.stderr: 53150K .......... .......... .......... .......... .......... 57% 90.8M 0s 2020-04-28T12:42:07.345 INFO:teuthology.orchestra.run.smithi197.stderr: 53200K .......... .......... .......... .......... .......... 57% 116M 0s 2020-04-28T12:42:07.345 INFO:teuthology.orchestra.run.smithi197.stderr: 53250K .......... .......... .......... .......... .......... 57% 120M 0s 2020-04-28T12:42:07.346 INFO:teuthology.orchestra.run.smithi197.stderr: 53300K .......... .......... .......... .......... .......... 57% 113M 0s 2020-04-28T12:42:07.346 INFO:teuthology.orchestra.run.smithi197.stderr: 53350K .......... .......... .......... .......... .......... 57% 110M 0s 2020-04-28T12:42:07.346 INFO:teuthology.orchestra.run.smithi197.stderr: 53400K .......... .......... .......... .......... .......... 57% 112M 0s 2020-04-28T12:42:07.346 INFO:teuthology.orchestra.run.smithi197.stderr: 53450K .......... .......... .......... .......... .......... 57% 120M 0s 2020-04-28T12:42:07.346 INFO:teuthology.orchestra.run.smithi197.stderr: 53500K .......... .......... .......... .......... .......... 57% 113M 0s 2020-04-28T12:42:07.346 INFO:teuthology.orchestra.run.smithi197.stderr: 53550K .......... .......... .......... .......... .......... 57% 90.2M 0s 2020-04-28T12:42:07.346 INFO:teuthology.orchestra.run.smithi197.stderr: 53600K .......... .......... .......... .......... .......... 57% 112M 0s 2020-04-28T12:42:07.347 INFO:teuthology.orchestra.run.smithi197.stderr: 53650K .......... .......... .......... .......... .......... 57% 118M 0s 2020-04-28T12:42:07.347 INFO:teuthology.orchestra.run.smithi197.stderr: 53700K .......... .......... .......... .......... .......... 57% 116M 0s 2020-04-28T12:42:07.347 INFO:teuthology.orchestra.run.smithi197.stderr: 53750K .......... .......... .......... .......... .......... 57% 115M 0s 2020-04-28T12:42:07.347 INFO:teuthology.orchestra.run.smithi197.stderr: 53800K .......... .......... .......... .......... .......... 57% 111M 0s 2020-04-28T12:42:07.347 INFO:teuthology.orchestra.run.smithi197.stderr: 53850K .......... .......... .......... .......... .......... 58% 116M 0s 2020-04-28T12:42:07.347 INFO:teuthology.orchestra.run.smithi197.stderr: 53900K .......... .......... .......... .......... .......... 58% 111M 0s 2020-04-28T12:42:07.347 INFO:teuthology.orchestra.run.smithi197.stderr: 53950K .......... .......... .......... .......... .......... 58% 92.0M 0s 2020-04-28T12:42:07.348 INFO:teuthology.orchestra.run.smithi197.stderr: 54000K .......... .......... .......... .......... .......... 58% 116M 0s 2020-04-28T12:42:07.348 INFO:teuthology.orchestra.run.smithi197.stderr: 54050K .......... .......... .......... .......... .......... 58% 115M 0s 2020-04-28T12:42:07.348 INFO:teuthology.orchestra.run.smithi197.stderr: 54100K .......... .......... .......... .......... .......... 58% 111M 0s 2020-04-28T12:42:07.348 INFO:teuthology.orchestra.run.smithi197.stderr: 54150K .......... .......... .......... .......... .......... 58% 95.5M 0s 2020-04-28T12:42:07.348 INFO:teuthology.orchestra.run.smithi197.stderr: 54200K .......... .......... .......... .......... .......... 58% 116M 0s 2020-04-28T12:42:07.348 INFO:teuthology.orchestra.run.smithi197.stderr: 54250K .......... .......... .......... .......... .......... 58% 115M 0s 2020-04-28T12:42:07.348 INFO:teuthology.orchestra.run.smithi197.stderr: 54300K .......... .......... .......... .......... .......... 58% 120M 0s 2020-04-28T12:42:07.349 INFO:teuthology.orchestra.run.smithi197.stderr: 54350K .......... .......... .......... .......... .......... 58% 90.2M 0s 2020-04-28T12:42:07.349 INFO:teuthology.orchestra.run.smithi197.stderr: 54400K .......... .......... .......... .......... .......... 58% 110M 0s 2020-04-28T12:42:07.349 INFO:teuthology.orchestra.run.smithi197.stderr: 54450K .......... .......... .......... .......... .......... 58% 116M 0s 2020-04-28T12:42:07.349 INFO:teuthology.orchestra.run.smithi197.stderr: 54500K .......... .......... .......... .......... .......... 58% 115M 0s 2020-04-28T12:42:07.349 INFO:teuthology.orchestra.run.smithi197.stderr: 54550K .......... .......... .......... .......... .......... 58% 116M 0s 2020-04-28T12:42:07.349 INFO:teuthology.orchestra.run.smithi197.stderr: 54600K .......... .......... .......... .......... .......... 58% 115M 0s 2020-04-28T12:42:07.349 INFO:teuthology.orchestra.run.smithi197.stderr: 54650K .......... .......... .......... .......... .......... 58% 120M 0s 2020-04-28T12:42:07.350 INFO:teuthology.orchestra.run.smithi197.stderr: 54700K .......... .......... .......... .......... .......... 58% 112M 0s 2020-04-28T12:42:07.350 INFO:teuthology.orchestra.run.smithi197.stderr: 54750K .......... .......... .......... .......... .......... 58% 91.3M 0s 2020-04-28T12:42:07.350 INFO:teuthology.orchestra.run.smithi197.stderr: 54800K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:42:07.350 INFO:teuthology.orchestra.run.smithi197.stderr: 54850K .......... .......... .......... .......... .......... 59% 106M 0s 2020-04-28T12:42:07.350 INFO:teuthology.orchestra.run.smithi197.stderr: 54900K .......... .......... .......... .......... .......... 59% 116M 0s 2020-04-28T12:42:07.350 INFO:teuthology.orchestra.run.smithi197.stderr: 54950K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:42:07.350 INFO:teuthology.orchestra.run.smithi197.stderr: 55000K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:42:07.351 INFO:teuthology.orchestra.run.smithi197.stderr: 55050K .......... .......... .......... .......... .......... 59% 120M 0s 2020-04-28T12:42:07.351 INFO:teuthology.orchestra.run.smithi197.stderr: 55100K .......... .......... .......... .......... .......... 59% 114M 0s 2020-04-28T12:42:07.351 INFO:teuthology.orchestra.run.smithi197.stderr: 55150K .......... .......... .......... .......... .......... 59% 91.2M 0s 2020-04-28T12:42:07.351 INFO:teuthology.orchestra.run.smithi197.stderr: 55200K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:42:07.351 INFO:teuthology.orchestra.run.smithi197.stderr: 55250K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:42:07.352 INFO:teuthology.orchestra.run.smithi197.stderr: 55300K .......... .......... .......... .......... .......... 59% 114M 0s 2020-04-28T12:42:07.352 INFO:teuthology.orchestra.run.smithi197.stderr: 55350K .......... .......... .......... .......... .......... 59% 112M 0s 2020-04-28T12:42:07.352 INFO:teuthology.orchestra.run.smithi197.stderr: 55400K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:42:07.352 INFO:teuthology.orchestra.run.smithi197.stderr: 55450K .......... .......... .......... .......... .......... 59% 119M 0s 2020-04-28T12:42:07.352 INFO:teuthology.orchestra.run.smithi197.stderr: 55500K .......... .......... .......... .......... .......... 59% 115M 0s 2020-04-28T12:42:07.352 INFO:teuthology.orchestra.run.smithi197.stderr: 55550K .......... .......... .......... .......... .......... 59% 90.6M 0s 2020-04-28T12:42:07.352 INFO:teuthology.orchestra.run.smithi197.stderr: 55600K .......... .......... .......... .......... .......... 59% 116M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 55650K .......... .......... .......... .......... .......... 59% 113M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 55700K .......... .......... .......... .......... .......... 60% 118M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 55750K .......... .......... .......... .......... .......... 60% 112M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 55800K .......... .......... .......... .......... .......... 60% 116M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 55850K .......... .......... .......... .......... .......... 60% 118M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 55900K .......... .......... .......... .......... .......... 60% 125M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 55950K .......... .......... .......... .......... .......... 60% 87.5M 0s 2020-04-28T12:42:07.353 INFO:teuthology.orchestra.run.smithi197.stderr: 56000K .......... .......... .......... .......... .......... 60% 116M 0s 2020-04-28T12:42:07.354 INFO:teuthology.orchestra.run.smithi197.stderr: 56050K .......... .......... .......... .......... .......... 60% 115M 0s 2020-04-28T12:42:07.354 INFO:teuthology.orchestra.run.smithi197.stderr: 56100K .......... .......... .......... .......... .......... 60% 114M 0s 2020-04-28T12:42:07.354 INFO:teuthology.orchestra.run.smithi197.stderr: 56150K .......... .......... .......... .......... .......... 60% 109M 0s 2020-04-28T12:42:07.354 INFO:teuthology.orchestra.run.smithi197.stderr: 56200K .......... .......... .......... .......... .......... 60% 120M 0s 2020-04-28T12:42:07.354 INFO:teuthology.orchestra.run.smithi197.stderr: 56250K .......... .......... .......... .......... .......... 60% 117M 0s 2020-04-28T12:42:07.354 INFO:teuthology.orchestra.run.smithi197.stderr: 56300K .......... .......... .......... .......... .......... 60% 111M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56350K .......... .......... .......... .......... .......... 60% 91.5M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56400K .......... .......... .......... .......... .......... 60% 114M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56450K .......... .......... .......... .......... .......... 60% 118M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56500K .......... .......... .......... .......... .......... 60% 116M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56550K .......... .......... .......... .......... .......... 60% 114M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56600K .......... .......... .......... .......... .......... 60% 114M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56650K .......... .......... .......... .......... .......... 61% 118M 0s 2020-04-28T12:42:07.355 INFO:teuthology.orchestra.run.smithi197.stderr: 56700K .......... .......... .......... .......... .......... 61% 118M 0s 2020-04-28T12:42:07.356 INFO:teuthology.orchestra.run.smithi197.stderr: 56750K .......... .......... .......... .......... .......... 61% 86.0M 0s 2020-04-28T12:42:07.356 INFO:teuthology.orchestra.run.smithi197.stderr: 56800K .......... .......... .......... .......... .......... 61% 111M 0s 2020-04-28T12:42:07.356 INFO:teuthology.orchestra.run.smithi197.stderr: 56850K .......... .......... .......... .......... .......... 61% 121M 0s 2020-04-28T12:42:07.356 INFO:teuthology.orchestra.run.smithi197.stderr: 56900K .......... .......... .......... .......... .......... 61% 120M 0s 2020-04-28T12:42:07.356 INFO:teuthology.orchestra.run.smithi197.stderr: 56950K .......... .......... .......... .......... .......... 61% 108M 0s 2020-04-28T12:42:07.356 INFO:teuthology.orchestra.run.smithi197.stderr: 57000K .......... .......... .......... .......... .......... 61% 119M 0s 2020-04-28T12:42:07.356 INFO:teuthology.orchestra.run.smithi197.stderr: 57050K .......... .......... .......... .......... .......... 61% 112M 0s 2020-04-28T12:42:07.357 INFO:teuthology.orchestra.run.smithi197.stderr: 57100K .......... .......... .......... .......... .......... 61% 117M 0s 2020-04-28T12:42:07.357 INFO:teuthology.orchestra.run.smithi197.stderr: 57150K .......... .......... .......... .......... .......... 61% 90.2M 0s 2020-04-28T12:42:07.357 INFO:teuthology.orchestra.run.smithi197.stderr: 57200K .......... .......... .......... .......... .......... 61% 116M 0s 2020-04-28T12:42:07.357 INFO:teuthology.orchestra.run.smithi197.stderr: 57250K .......... .......... .......... .......... .......... 61% 118M 0s 2020-04-28T12:42:07.357 INFO:teuthology.orchestra.run.smithi197.stderr: 57300K .......... .......... .......... .......... .......... 61% 117M 0s 2020-04-28T12:42:07.357 INFO:teuthology.orchestra.run.smithi197.stderr: 57350K .......... .......... .......... .......... .......... 61% 110M 0s 2020-04-28T12:42:07.357 INFO:teuthology.orchestra.run.smithi197.stderr: 57400K .......... .......... .......... .......... .......... 61% 118M 0s 2020-04-28T12:42:07.358 INFO:teuthology.orchestra.run.smithi197.stderr: 57450K .......... .......... .......... .......... .......... 61% 113M 0s 2020-04-28T12:42:07.358 INFO:teuthology.orchestra.run.smithi197.stderr: 57500K .......... .......... .......... .......... .......... 61% 113M 0s 2020-04-28T12:42:07.358 INFO:teuthology.orchestra.run.smithi197.stderr: 57550K .......... .......... .......... .......... .......... 62% 91.0M 0s 2020-04-28T12:42:07.358 INFO:teuthology.orchestra.run.smithi197.stderr: 57600K .......... .......... .......... .......... .......... 62% 118M 0s 2020-04-28T12:42:07.358 INFO:teuthology.orchestra.run.smithi197.stderr: 57650K .......... .......... .......... .......... .......... 62% 121M 0s 2020-04-28T12:42:07.358 INFO:teuthology.orchestra.run.smithi197.stderr: 57700K .......... .......... .......... .......... .......... 62% 110M 0s 2020-04-28T12:42:07.358 INFO:teuthology.orchestra.run.smithi197.stderr: 57750K .......... .......... .......... .......... .......... 62% 104M 0s 2020-04-28T12:42:07.359 INFO:teuthology.orchestra.run.smithi197.stderr: 57800K .......... .......... .......... .......... .......... 62% 120M 0s 2020-04-28T12:42:07.359 INFO:teuthology.orchestra.run.smithi197.stderr: 57850K .......... .......... .......... .......... .......... 62% 115M 0s 2020-04-28T12:42:07.359 INFO:teuthology.orchestra.run.smithi197.stderr: 57900K .......... .......... .......... .......... .......... 62% 113M 0s 2020-04-28T12:42:07.359 INFO:teuthology.orchestra.run.smithi197.stderr: 57950K .......... .......... .......... .......... .......... 62% 91.7M 0s 2020-04-28T12:42:07.359 INFO:teuthology.orchestra.run.smithi197.stderr: 58000K .......... .......... .......... .......... .......... 62% 119M 0s 2020-04-28T12:42:07.359 INFO:teuthology.orchestra.run.smithi197.stderr: 58050K .......... .......... .......... .......... .......... 62% 114M 0s 2020-04-28T12:42:07.359 INFO:teuthology.orchestra.run.smithi197.stderr: 58100K .......... .......... .......... .......... .......... 62% 115M 0s 2020-04-28T12:42:07.360 INFO:teuthology.orchestra.run.smithi197.stderr: 58150K .......... .......... .......... .......... .......... 62% 115M 0s 2020-04-28T12:42:07.360 INFO:teuthology.orchestra.run.smithi197.stderr: 58200K .......... .......... .......... .......... .......... 62% 103M 0s 2020-04-28T12:42:07.360 INFO:teuthology.orchestra.run.smithi197.stderr: 58250K .......... .......... .......... .......... .......... 62% 116M 0s 2020-04-28T12:42:07.360 INFO:teuthology.orchestra.run.smithi197.stderr: 58300K .......... .......... .......... .......... .......... 62% 119M 0s 2020-04-28T12:42:07.360 INFO:teuthology.orchestra.run.smithi197.stderr: 58350K .......... .......... .......... .......... .......... 62% 83.7M 0s 2020-04-28T12:42:07.360 INFO:teuthology.orchestra.run.smithi197.stderr: 58400K .......... .......... .......... .......... .......... 62% 117M 0s 2020-04-28T12:42:07.360 INFO:teuthology.orchestra.run.smithi197.stderr: 58450K .......... .......... .......... .......... .......... 62% 89.0M 0s 2020-04-28T12:42:07.361 INFO:teuthology.orchestra.run.smithi197.stderr: 58500K .......... .......... .......... .......... .......... 63% 165M 0s 2020-04-28T12:42:07.361 INFO:teuthology.orchestra.run.smithi197.stderr: 58550K .......... .......... .......... .......... .......... 63% 108M 0s 2020-04-28T12:42:07.361 INFO:teuthology.orchestra.run.smithi197.stderr: 58600K .......... .......... .......... .......... .......... 63% 117M 0s 2020-04-28T12:42:07.361 INFO:teuthology.orchestra.run.smithi197.stderr: 58650K .......... .......... .......... .......... .......... 63% 109M 0s 2020-04-28T12:42:07.361 INFO:teuthology.orchestra.run.smithi197.stderr: 58700K .......... .......... .......... .......... .......... 63% 126M 0s 2020-04-28T12:42:07.361 INFO:teuthology.orchestra.run.smithi197.stderr: 58750K .......... .......... .......... .......... .......... 63% 91.3M 0s 2020-04-28T12:42:07.361 INFO:teuthology.orchestra.run.smithi197.stderr: 58800K .......... .......... .......... .......... .......... 63% 115M 0s 2020-04-28T12:42:07.362 INFO:teuthology.orchestra.run.smithi197.stderr: 58850K .......... .......... .......... .......... .......... 63% 113M 0s 2020-04-28T12:42:07.362 INFO:teuthology.orchestra.run.smithi197.stderr: 58900K .......... .......... .......... .......... .......... 63% 123M 0s 2020-04-28T12:42:07.362 INFO:teuthology.orchestra.run.smithi197.stderr: 58950K .......... .......... .......... .......... .......... 63% 110M 0s 2020-04-28T12:42:07.362 INFO:teuthology.orchestra.run.smithi197.stderr: 59000K .......... .......... .......... .......... .......... 63% 107M 0s 2020-04-28T12:42:07.362 INFO:teuthology.orchestra.run.smithi197.stderr: 59050K .......... .......... .......... .......... .......... 63% 126M 0s 2020-04-28T12:42:07.362 INFO:teuthology.orchestra.run.smithi197.stderr: 59100K .......... .......... .......... .......... .......... 63% 115M 0s 2020-04-28T12:42:07.362 INFO:teuthology.orchestra.run.smithi197.stderr: 59150K .......... .......... .......... .......... .......... 63% 89.2M 0s 2020-04-28T12:42:07.363 INFO:teuthology.orchestra.run.smithi197.stderr: 59200K .......... .......... .......... .......... .......... 63% 117M 0s 2020-04-28T12:42:07.363 INFO:teuthology.orchestra.run.smithi197.stderr: 59250K .......... .......... .......... .......... .......... 63% 80.8M 0s 2020-04-28T12:42:07.363 INFO:teuthology.orchestra.run.smithi197.stderr: 59300K .......... .......... .......... .......... .......... 63% 202M 0s 2020-04-28T12:42:07.363 INFO:teuthology.orchestra.run.smithi197.stderr: 59350K .......... .......... .......... .......... .......... 63% 108M 0s 2020-04-28T12:42:07.363 INFO:teuthology.orchestra.run.smithi197.stderr: 59400K .......... .......... .......... .......... .......... 63% 111M 0s 2020-04-28T12:42:07.363 INFO:teuthology.orchestra.run.smithi197.stderr: 59450K .......... .......... .......... .......... .......... 64% 115M 0s 2020-04-28T12:42:07.363 INFO:teuthology.orchestra.run.smithi197.stderr: 59500K .......... .......... .......... .......... .......... 64% 112M 0s 2020-04-28T12:42:07.364 INFO:teuthology.orchestra.run.smithi197.stderr: 59550K .......... .......... .......... .......... .......... 64% 88.5M 0s 2020-04-28T12:42:07.364 INFO:teuthology.orchestra.run.smithi197.stderr: 59600K .......... .......... .......... .......... .......... 64% 120M 0s 2020-04-28T12:42:07.364 INFO:teuthology.orchestra.run.smithi197.stderr: 59650K .......... .......... .......... .......... .......... 64% 115M 0s 2020-04-28T12:42:07.364 INFO:teuthology.orchestra.run.smithi197.stderr: 59700K .......... .......... .......... .......... .......... 64% 121M 0s 2020-04-28T12:42:07.364 INFO:teuthology.orchestra.run.smithi197.stderr: 59750K .......... .......... .......... .......... .......... 64% 110M 0s 2020-04-28T12:42:07.364 INFO:teuthology.orchestra.run.smithi197.stderr: 59800K .......... .......... .......... .......... .......... 64% 116M 0s 2020-04-28T12:42:07.364 INFO:teuthology.orchestra.run.smithi197.stderr: 59850K .......... .......... .......... .......... .......... 64% 120M 0s 2020-04-28T12:42:07.365 INFO:teuthology.orchestra.run.smithi197.stderr: 59900K .......... .......... .......... .......... .......... 64% 116M 0s 2020-04-28T12:42:07.365 INFO:teuthology.orchestra.run.smithi197.stderr: 59950K .......... .......... .......... .......... .......... 64% 89.4M 0s 2020-04-28T12:42:07.365 INFO:teuthology.orchestra.run.smithi197.stderr: 60000K .......... .......... .......... .......... .......... 64% 117M 0s 2020-04-28T12:42:07.365 INFO:teuthology.orchestra.run.smithi197.stderr: 60050K .......... .......... .......... .......... .......... 64% 119M 0s 2020-04-28T12:42:07.365 INFO:teuthology.orchestra.run.smithi197.stderr: 60100K .......... .......... .......... .......... .......... 64% 117M 0s 2020-04-28T12:42:07.365 INFO:teuthology.orchestra.run.smithi197.stderr: 60150K .......... .......... .......... .......... .......... 64% 113M 0s 2020-04-28T12:42:07.365 INFO:teuthology.orchestra.run.smithi197.stderr: 60200K .......... .......... .......... .......... .......... 64% 114M 0s 2020-04-28T12:42:07.366 INFO:teuthology.orchestra.run.smithi197.stderr: 60250K .......... .......... .......... .......... .......... 64% 112M 0s 2020-04-28T12:42:07.366 INFO:teuthology.orchestra.run.smithi197.stderr: 60300K .......... .......... .......... .......... .......... 64% 113M 0s 2020-04-28T12:42:07.366 INFO:teuthology.orchestra.run.smithi197.stderr: 60350K .......... .......... .......... .......... .......... 65% 91.3M 0s 2020-04-28T12:42:07.366 INFO:teuthology.orchestra.run.smithi197.stderr: 60400K .......... .......... .......... .......... .......... 65% 118M 0s 2020-04-28T12:42:07.366 INFO:teuthology.orchestra.run.smithi197.stderr: 60450K .......... .......... .......... .......... .......... 65% 110M 0s 2020-04-28T12:42:07.366 INFO:teuthology.orchestra.run.smithi197.stderr: 60500K .......... .......... .......... .......... .......... 65% 123M 0s 2020-04-28T12:42:07.366 INFO:teuthology.orchestra.run.smithi197.stderr: 60550K .......... .......... .......... .......... .......... 65% 111M 0s 2020-04-28T12:42:07.367 INFO:teuthology.orchestra.run.smithi197.stderr: 60600K .......... .......... .......... .......... .......... 65% 83.9M 0s 2020-04-28T12:42:07.367 INFO:teuthology.orchestra.run.smithi197.stderr: 60650K .......... .......... .......... .......... .......... 65% 192M 0s 2020-04-28T12:42:07.367 INFO:teuthology.orchestra.run.smithi197.stderr: 60700K .......... .......... .......... .......... .......... 65% 111M 0s 2020-04-28T12:42:07.367 INFO:teuthology.orchestra.run.smithi197.stderr: 60750K .......... .......... .......... .......... .......... 65% 93.4M 0s 2020-04-28T12:42:07.367 INFO:teuthology.orchestra.run.smithi197.stderr: 60800K .......... .......... .......... .......... .......... 65% 112M 0s 2020-04-28T12:42:07.367 INFO:teuthology.orchestra.run.smithi197.stderr: 60850K .......... .......... .......... .......... .......... 65% 123M 0s 2020-04-28T12:42:07.368 INFO:teuthology.orchestra.run.smithi197.stderr: 60900K .......... .......... .......... .......... .......... 65% 107M 0s 2020-04-28T12:42:07.368 INFO:teuthology.orchestra.run.smithi197.stderr: 60950K .......... .......... .......... .......... .......... 65% 114M 0s 2020-04-28T12:42:07.368 INFO:teuthology.orchestra.run.smithi197.stderr: 61000K .......... .......... .......... .......... .......... 65% 115M 0s 2020-04-28T12:42:07.368 INFO:teuthology.orchestra.run.smithi197.stderr: 61050K .......... .......... .......... .......... .......... 65% 120M 0s 2020-04-28T12:42:07.368 INFO:teuthology.orchestra.run.smithi197.stderr: 61100K .......... .......... .......... .......... .......... 65% 111M 0s 2020-04-28T12:42:07.368 INFO:teuthology.orchestra.run.smithi197.stderr: 61150K .......... .......... .......... .......... .......... 65% 91.9M 0s 2020-04-28T12:42:07.368 INFO:teuthology.orchestra.run.smithi197.stderr: 61200K .......... .......... .......... .......... .......... 65% 113M 0s 2020-04-28T12:42:07.369 INFO:teuthology.orchestra.run.smithi197.stderr: 61250K .......... .......... .......... .......... .......... 65% 121M 0s 2020-04-28T12:42:07.369 INFO:teuthology.orchestra.run.smithi197.stderr: 61300K .......... .......... .......... .......... .......... 66% 108M 0s 2020-04-28T12:42:07.369 INFO:teuthology.orchestra.run.smithi197.stderr: 61350K .......... .......... .......... .......... .......... 66% 113M 0s 2020-04-28T12:42:07.369 INFO:teuthology.orchestra.run.smithi197.stderr: 61400K .......... .......... .......... .......... .......... 66% 114M 0s 2020-04-28T12:42:07.369 INFO:teuthology.orchestra.run.smithi197.stderr: 61450K .......... .......... .......... .......... .......... 66% 122M 0s 2020-04-28T12:42:07.369 INFO:teuthology.orchestra.run.smithi197.stderr: 61500K .......... .......... .......... .......... .......... 66% 113M 0s 2020-04-28T12:42:07.369 INFO:teuthology.orchestra.run.smithi197.stderr: 61550K .......... .......... .......... .......... .......... 66% 89.4M 0s 2020-04-28T12:42:07.370 INFO:teuthology.orchestra.run.smithi197.stderr: 61600K .......... .......... .......... .......... .......... 66% 115M 0s 2020-04-28T12:42:07.370 INFO:teuthology.orchestra.run.smithi197.stderr: 61650K .......... .......... .......... .......... .......... 66% 119M 0s 2020-04-28T12:42:07.370 INFO:teuthology.orchestra.run.smithi197.stderr: 61700K .......... .......... .......... .......... .......... 66% 98.1M 0s 2020-04-28T12:42:07.370 INFO:teuthology.orchestra.run.smithi197.stderr: 61750K .......... .......... .......... .......... .......... 66% 138M 0s 2020-04-28T12:42:07.370 INFO:teuthology.orchestra.run.smithi197.stderr: 61800K .......... .......... .......... .......... .......... 66% 113M 0s 2020-04-28T12:42:07.370 INFO:teuthology.orchestra.run.smithi197.stderr: 61850K .......... .......... .......... .......... .......... 66% 113M 0s 2020-04-28T12:42:07.371 INFO:teuthology.orchestra.run.smithi197.stderr: 61900K .......... .......... .......... .......... .......... 66% 117M 0s 2020-04-28T12:42:07.371 INFO:teuthology.orchestra.run.smithi197.stderr: 61950K .......... .......... .......... .......... .......... 66% 88.0M 0s 2020-04-28T12:42:07.371 INFO:teuthology.orchestra.run.smithi197.stderr: 62000K .......... .......... .......... .......... .......... 66% 112M 0s 2020-04-28T12:42:07.371 INFO:teuthology.orchestra.run.smithi197.stderr: 62050K .......... .......... .......... .......... .......... 66% 113M 0s 2020-04-28T12:42:07.371 INFO:teuthology.orchestra.run.smithi197.stderr: 62100K .......... .......... .......... .......... .......... 66% 112M 0s 2020-04-28T12:42:07.371 INFO:teuthology.orchestra.run.smithi197.stderr: 62150K .......... .......... .......... .......... .......... 66% 111M 0s 2020-04-28T12:42:07.371 INFO:teuthology.orchestra.run.smithi197.stderr: 62200K .......... .......... .......... .......... .......... 67% 111M 0s 2020-04-28T12:42:07.372 INFO:teuthology.orchestra.run.smithi197.stderr: 62250K .......... .......... .......... .......... .......... 67% 116M 0s 2020-04-28T12:42:07.372 INFO:teuthology.orchestra.run.smithi197.stderr: 62300K .......... .......... .......... .......... .......... 67% 117M 0s 2020-04-28T12:42:07.372 INFO:teuthology.orchestra.run.smithi197.stderr: 62350K .......... .......... .......... .......... .......... 67% 93.8M 0s 2020-04-28T12:42:07.372 INFO:teuthology.orchestra.run.smithi197.stderr: 62400K .......... .......... .......... .......... .......... 67% 115M 0s 2020-04-28T12:42:07.372 INFO:teuthology.orchestra.run.smithi197.stderr: 62450K .......... .......... .......... .......... .......... 67% 113M 0s 2020-04-28T12:42:07.372 INFO:teuthology.orchestra.run.smithi197.stderr: 62500K .......... .......... .......... .......... .......... 67% 117M 0s 2020-04-28T12:42:07.372 INFO:teuthology.orchestra.run.smithi197.stderr: 62550K .......... .......... .......... .......... .......... 67% 114M 0s 2020-04-28T12:42:07.373 INFO:teuthology.orchestra.run.smithi197.stderr: 62600K .......... .......... .......... .......... .......... 67% 118M 0s 2020-04-28T12:42:07.373 INFO:teuthology.orchestra.run.smithi197.stderr: 62650K .......... .......... .......... .......... .......... 67% 117M 0s 2020-04-28T12:42:07.373 INFO:teuthology.orchestra.run.smithi197.stderr: 62700K .......... .......... .......... .......... .......... 67% 114M 0s 2020-04-28T12:42:07.373 INFO:teuthology.orchestra.run.smithi197.stderr: 62750K .......... .......... .......... .......... .......... 67% 86.1M 0s 2020-04-28T12:42:07.373 INFO:teuthology.orchestra.run.smithi197.stderr: 62800K .......... .......... .......... .......... .......... 67% 119M 0s 2020-04-28T12:42:07.373 INFO:teuthology.orchestra.run.smithi197.stderr: 62850K .......... .......... .......... .......... .......... 67% 114M 0s 2020-04-28T12:42:07.373 INFO:teuthology.orchestra.run.smithi197.stderr: 62900K .......... .......... .......... .......... .......... 67% 114M 0s 2020-04-28T12:42:07.374 INFO:teuthology.orchestra.run.smithi197.stderr: 62950K .......... .......... .......... .......... .......... 67% 119M 0s 2020-04-28T12:42:07.374 INFO:teuthology.orchestra.run.smithi197.stderr: 63000K .......... .......... .......... .......... .......... 67% 114M 0s 2020-04-28T12:42:07.374 INFO:teuthology.orchestra.run.smithi197.stderr: 63050K .......... .......... .......... .......... .......... 67% 115M 0s 2020-04-28T12:42:07.374 INFO:teuthology.orchestra.run.smithi197.stderr: 63100K .......... .......... .......... .......... .......... 67% 119M 0s 2020-04-28T12:42:07.374 INFO:teuthology.orchestra.run.smithi197.stderr: 63150K .......... .......... .......... .......... .......... 68% 89.4M 0s 2020-04-28T12:42:07.374 INFO:teuthology.orchestra.run.smithi197.stderr: 63200K .......... .......... .......... .......... .......... 68% 116M 0s 2020-04-28T12:42:07.374 INFO:teuthology.orchestra.run.smithi197.stderr: 63250K .......... .......... .......... .......... .......... 68% 105M 0s 2020-04-28T12:42:07.375 INFO:teuthology.orchestra.run.smithi197.stderr: 63300K .......... .......... .......... .......... .......... 68% 112M 0s 2020-04-28T12:42:07.375 INFO:teuthology.orchestra.run.smithi197.stderr: 63350K .......... .......... .......... .......... .......... 68% 115M 0s 2020-04-28T12:42:07.375 INFO:teuthology.orchestra.run.smithi197.stderr: 63400K .......... .......... .......... .......... .......... 68% 109M 0s 2020-04-28T12:42:07.375 INFO:teuthology.orchestra.run.smithi197.stderr: 63450K .......... .......... .......... .......... .......... 68% 127M 0s 2020-04-28T12:42:07.375 INFO:teuthology.orchestra.run.smithi197.stderr: 63500K .......... .......... .......... .......... .......... 68% 112M 0s 2020-04-28T12:42:07.375 INFO:teuthology.orchestra.run.smithi197.stderr: 63550K .......... .......... .......... .......... .......... 68% 89.8M 0s 2020-04-28T12:42:07.375 INFO:teuthology.orchestra.run.smithi197.stderr: 63600K .......... .......... .......... .......... .......... 68% 105M 0s 2020-04-28T12:42:07.376 INFO:teuthology.orchestra.run.smithi197.stderr: 63650K .......... .......... .......... .......... .......... 68% 109M 0s 2020-04-28T12:42:07.376 INFO:teuthology.orchestra.run.smithi197.stderr: 63700K .......... .......... .......... .......... .......... 68% 117M 0s 2020-04-28T12:42:07.376 INFO:teuthology.orchestra.run.smithi197.stderr: 63750K .......... .......... .......... .......... .......... 68% 104M 0s 2020-04-28T12:42:07.376 INFO:teuthology.orchestra.run.smithi197.stderr: 63800K .......... .......... .......... .......... .......... 68% 116M 0s 2020-04-28T12:42:07.376 INFO:teuthology.orchestra.run.smithi197.stderr: 63850K .......... .......... .......... .......... .......... 68% 112M 0s 2020-04-28T12:42:07.376 INFO:teuthology.orchestra.run.smithi197.stderr: 63900K .......... .......... .......... .......... .......... 68% 109M 0s 2020-04-28T12:42:07.376 INFO:teuthology.orchestra.run.smithi197.stderr: 63950K .......... .......... .......... .......... .......... 68% 97.4M 0s 2020-04-28T12:42:07.377 INFO:teuthology.orchestra.run.smithi197.stderr: 64000K .......... .......... .......... .......... .......... 68% 116M 0s 2020-04-28T12:42:07.377 INFO:teuthology.orchestra.run.smithi197.stderr: 64050K .......... .......... .......... .......... .......... 68% 115M 0s 2020-04-28T12:42:07.377 INFO:teuthology.orchestra.run.smithi197.stderr: 64100K .......... .......... .......... .......... .......... 69% 108M 0s 2020-04-28T12:42:07.377 INFO:teuthology.orchestra.run.smithi197.stderr: 64150K .......... .......... .......... .......... .......... 69% 115M 0s 2020-04-28T12:42:07.377 INFO:teuthology.orchestra.run.smithi197.stderr: 64200K .......... .......... .......... .......... .......... 69% 117M 0s 2020-04-28T12:42:07.377 INFO:teuthology.orchestra.run.smithi197.stderr: 64250K .......... .......... .......... .......... .......... 69% 120M 0s 2020-04-28T12:42:07.377 INFO:teuthology.orchestra.run.smithi197.stderr: 64300K .......... .......... .......... .......... .......... 69% 113M 0s 2020-04-28T12:42:07.378 INFO:teuthology.orchestra.run.smithi197.stderr: 64350K .......... .......... .......... .......... .......... 69% 83.8M 0s 2020-04-28T12:42:07.378 INFO:teuthology.orchestra.run.smithi197.stderr: 64400K .......... .......... .......... .......... .......... 69% 122M 0s 2020-04-28T12:42:07.378 INFO:teuthology.orchestra.run.smithi197.stderr: 64450K .......... .......... .......... .......... .......... 69% 96.9M 0s 2020-04-28T12:42:07.378 INFO:teuthology.orchestra.run.smithi197.stderr: 64500K .......... .......... .......... .......... .......... 69% 108M 0s 2020-04-28T12:42:07.378 INFO:teuthology.orchestra.run.smithi197.stderr: 64550K .......... .......... .......... .......... .......... 69% 120M 0s 2020-04-28T12:42:07.378 INFO:teuthology.orchestra.run.smithi197.stderr: 64600K .......... .......... .......... .......... .......... 69% 113M 0s 2020-04-28T12:42:07.378 INFO:teuthology.orchestra.run.smithi197.stderr: 64650K .......... .......... .......... .......... .......... 69% 139M 0s 2020-04-28T12:42:07.379 INFO:teuthology.orchestra.run.smithi197.stderr: 64700K .......... .......... .......... .......... .......... 69% 113M 0s 2020-04-28T12:42:07.379 INFO:teuthology.orchestra.run.smithi197.stderr: 64750K .......... .......... .......... .......... .......... 69% 78.3M 0s 2020-04-28T12:42:07.379 INFO:teuthology.orchestra.run.smithi197.stderr: 64800K .......... .......... .......... .......... .......... 69% 127M 0s 2020-04-28T12:42:07.379 INFO:teuthology.orchestra.run.smithi197.stderr: 64850K .......... .......... .......... .......... .......... 69% 94.3M 0s 2020-04-28T12:42:07.379 INFO:teuthology.orchestra.run.smithi197.stderr: 64900K .......... .......... .......... .......... .......... 69% 119M 0s 2020-04-28T12:42:07.379 INFO:teuthology.orchestra.run.smithi197.stderr: 64950K .......... .......... .......... .......... .......... 69% 129M 0s 2020-04-28T12:42:07.379 INFO:teuthology.orchestra.run.smithi197.stderr: 65000K .......... .......... .......... .......... .......... 70% 94.4M 0s 2020-04-28T12:42:07.380 INFO:teuthology.orchestra.run.smithi197.stderr: 65050K .......... .......... .......... .......... .......... 70% 127M 0s 2020-04-28T12:42:07.380 INFO:teuthology.orchestra.run.smithi197.stderr: 65100K .......... .......... .......... .......... .......... 70% 126M 0s 2020-04-28T12:42:07.380 INFO:teuthology.orchestra.run.smithi197.stderr: 65150K .......... .......... .......... .......... .......... 70% 77.2M 0s 2020-04-28T12:42:07.380 INFO:teuthology.orchestra.run.smithi197.stderr: 65200K .......... .......... .......... .......... .......... 70% 145M 0s 2020-04-28T12:42:07.380 INFO:teuthology.orchestra.run.smithi197.stderr: 65250K .......... .......... .......... .......... .......... 70% 112M 0s 2020-04-28T12:42:07.380 INFO:teuthology.orchestra.run.smithi197.stderr: 65300K .......... .......... .......... .......... .......... 70% 118M 0s 2020-04-28T12:42:07.380 INFO:teuthology.orchestra.run.smithi197.stderr: 65350K .......... .......... .......... .......... .......... 70% 104M 0s 2020-04-28T12:42:07.381 INFO:teuthology.orchestra.run.smithi197.stderr: 65400K .......... .......... .......... .......... .......... 70% 114M 0s 2020-04-28T12:42:07.381 INFO:teuthology.orchestra.run.smithi197.stderr: 65450K .......... .......... .......... .......... .......... 70% 113M 0s 2020-04-28T12:42:07.381 INFO:teuthology.orchestra.run.smithi197.stderr: 65500K .......... .......... .......... .......... .......... 70% 118M 0s 2020-04-28T12:42:07.381 INFO:teuthology.orchestra.run.smithi197.stderr: 65550K .......... .......... .......... .......... .......... 70% 90.1M 0s 2020-04-28T12:42:07.381 INFO:teuthology.orchestra.run.smithi197.stderr: 65600K .......... .......... .......... .......... .......... 70% 119M 0s 2020-04-28T12:42:07.381 INFO:teuthology.orchestra.run.smithi197.stderr: 65650K .......... .......... .......... .......... .......... 70% 111M 0s 2020-04-28T12:42:07.381 INFO:teuthology.orchestra.run.smithi197.stderr: 65700K .......... .......... .......... .......... .......... 70% 118M 0s 2020-04-28T12:42:07.382 INFO:teuthology.orchestra.run.smithi197.stderr: 65750K .......... .......... .......... .......... .......... 70% 111M 0s 2020-04-28T12:42:07.382 INFO:teuthology.orchestra.run.smithi197.stderr: 65800K .......... .......... .......... .......... .......... 70% 112M 0s 2020-04-28T12:42:07.382 INFO:teuthology.orchestra.run.smithi197.stderr: 65850K .......... .......... .......... .......... .......... 70% 108M 0s 2020-04-28T12:42:07.382 INFO:teuthology.orchestra.run.smithi197.stderr: 65900K .......... .......... .......... .......... .......... 70% 122M 0s 2020-04-28T12:42:07.382 INFO:teuthology.orchestra.run.smithi197.stderr: 65950K .......... .......... .......... .......... .......... 71% 89.7M 0s 2020-04-28T12:42:07.382 INFO:teuthology.orchestra.run.smithi197.stderr: 66000K .......... .......... .......... .......... .......... 71% 119M 0s 2020-04-28T12:42:07.382 INFO:teuthology.orchestra.run.smithi197.stderr: 66050K .......... .......... .......... .......... .......... 71% 119M 0s 2020-04-28T12:42:07.383 INFO:teuthology.orchestra.run.smithi197.stderr: 66100K .......... .......... .......... .......... .......... 71% 112M 0s 2020-04-28T12:42:07.383 INFO:teuthology.orchestra.run.smithi197.stderr: 66150K .......... .......... .......... .......... .......... 71% 113M 0s 2020-04-28T12:42:07.383 INFO:teuthology.orchestra.run.smithi197.stderr: 66200K .......... .......... .......... .......... .......... 71% 108M 0s 2020-04-28T12:42:07.383 INFO:teuthology.orchestra.run.smithi197.stderr: 66250K .......... .......... .......... .......... .......... 71% 114M 0s 2020-04-28T12:42:07.383 INFO:teuthology.orchestra.run.smithi197.stderr: 66300K .......... .......... .......... .......... .......... 71% 111M 0s 2020-04-28T12:42:07.383 INFO:teuthology.orchestra.run.smithi197.stderr: 66350K .......... .......... .......... .......... .......... 71% 95.7M 0s 2020-04-28T12:42:07.383 INFO:teuthology.orchestra.run.smithi197.stderr: 66400K .......... .......... .......... .......... .......... 71% 114M 0s 2020-04-28T12:42:07.384 INFO:teuthology.orchestra.run.smithi197.stderr: 66450K .......... .......... .......... .......... .......... 71% 119M 0s 2020-04-28T12:42:07.384 INFO:teuthology.orchestra.run.smithi197.stderr: 66500K .......... .......... .......... .......... .......... 71% 120M 0s 2020-04-28T12:42:07.384 INFO:teuthology.orchestra.run.smithi197.stderr: 66550K .......... .......... .......... .......... .......... 71% 112M 0s 2020-04-28T12:42:07.384 INFO:teuthology.orchestra.run.smithi197.stderr: 66600K .......... .......... .......... .......... .......... 71% 110M 0s 2020-04-28T12:42:07.384 INFO:teuthology.orchestra.run.smithi197.stderr: 66650K .......... .......... .......... .......... .......... 71% 115M 0s 2020-04-28T12:42:07.384 INFO:teuthology.orchestra.run.smithi197.stderr: 66700K .......... .......... .......... .......... .......... 71% 117M 0s 2020-04-28T12:42:07.384 INFO:teuthology.orchestra.run.smithi197.stderr: 66750K .......... .......... .......... .......... .......... 71% 89.7M 0s 2020-04-28T12:42:07.385 INFO:teuthology.orchestra.run.smithi197.stderr: 66800K .......... .......... .......... .......... .......... 71% 115M 0s 2020-04-28T12:42:07.385 INFO:teuthology.orchestra.run.smithi197.stderr: 66850K .......... .......... .......... .......... .......... 72% 107M 0s 2020-04-28T12:42:07.385 INFO:teuthology.orchestra.run.smithi197.stderr: 66900K .......... .......... .......... .......... .......... 72% 126M 0s 2020-04-28T12:42:07.385 INFO:teuthology.orchestra.run.smithi197.stderr: 66950K .......... .......... .......... .......... .......... 72% 113M 0s 2020-04-28T12:42:07.385 INFO:teuthology.orchestra.run.smithi197.stderr: 67000K .......... .......... .......... .......... .......... 72% 107M 0s 2020-04-28T12:42:07.385 INFO:teuthology.orchestra.run.smithi197.stderr: 67050K .......... .......... .......... .......... .......... 72% 120M 0s 2020-04-28T12:42:07.385 INFO:teuthology.orchestra.run.smithi197.stderr: 67100K .......... .......... .......... .......... .......... 72% 117M 0s 2020-04-28T12:42:07.386 INFO:teuthology.orchestra.run.smithi197.stderr: 67150K .......... .......... .......... .......... .......... 72% 90.4M 0s 2020-04-28T12:42:07.386 INFO:teuthology.orchestra.run.smithi197.stderr: 67200K .......... .......... .......... .......... .......... 72% 106M 0s 2020-04-28T12:42:07.386 INFO:teuthology.orchestra.run.smithi197.stderr: 67250K .......... .......... .......... .......... .......... 72% 122M 0s 2020-04-28T12:42:07.386 INFO:teuthology.orchestra.run.smithi197.stderr: 67300K .......... .......... .......... .......... .......... 72% 114M 0s 2020-04-28T12:42:07.386 INFO:teuthology.orchestra.run.smithi197.stderr: 67350K .......... .......... .......... .......... .......... 72% 111M 0s 2020-04-28T12:42:07.386 INFO:teuthology.orchestra.run.smithi197.stderr: 67400K .......... .......... .......... .......... .......... 72% 112M 0s 2020-04-28T12:42:07.386 INFO:teuthology.orchestra.run.smithi197.stderr: 67450K .......... .......... .......... .......... .......... 72% 111M 0s 2020-04-28T12:42:07.387 INFO:teuthology.orchestra.run.smithi197.stderr: 67500K .......... .......... .......... .......... .......... 72% 117M 0s 2020-04-28T12:42:07.387 INFO:teuthology.orchestra.run.smithi197.stderr: 67550K .......... .......... .......... .......... .......... 72% 76.2M 0s 2020-04-28T12:42:07.387 INFO:teuthology.orchestra.run.smithi197.stderr: 67600K .......... .......... .......... .......... .......... 72% 130M 0s 2020-04-28T12:42:07.387 INFO:teuthology.orchestra.run.smithi197.stderr: 67650K .......... .......... .......... .......... .......... 72% 111M 0s 2020-04-28T12:42:07.387 INFO:teuthology.orchestra.run.smithi197.stderr: 67700K .......... .......... .......... .......... .......... 72% 116M 0s 2020-04-28T12:42:07.387 INFO:teuthology.orchestra.run.smithi197.stderr: 67750K .......... .......... .......... .......... .......... 72% 112M 0s 2020-04-28T12:42:07.387 INFO:teuthology.orchestra.run.smithi197.stderr: 67800K .......... .......... .......... .......... .......... 73% 98.0M 0s 2020-04-28T12:42:07.388 INFO:teuthology.orchestra.run.smithi197.stderr: 67850K .......... .......... .......... .......... .......... 73% 128M 0s 2020-04-28T12:42:07.388 INFO:teuthology.orchestra.run.smithi197.stderr: 67900K .......... .......... .......... .......... .......... 73% 115M 0s 2020-04-28T12:42:07.388 INFO:teuthology.orchestra.run.smithi197.stderr: 67950K .......... .......... .......... .......... .......... 73% 87.7M 0s 2020-04-28T12:42:07.388 INFO:teuthology.orchestra.run.smithi197.stderr: 68000K .......... .......... .......... .......... .......... 73% 111M 0s 2020-04-28T12:42:07.388 INFO:teuthology.orchestra.run.smithi197.stderr: 68050K .......... .......... .......... .......... .......... 73% 126M 0s 2020-04-28T12:42:07.388 INFO:teuthology.orchestra.run.smithi197.stderr: 68100K .......... .......... .......... .......... .......... 73% 114M 0s 2020-04-28T12:42:07.388 INFO:teuthology.orchestra.run.smithi197.stderr: 68150K .......... .......... .......... .......... .......... 73% 106M 0s 2020-04-28T12:42:07.389 INFO:teuthology.orchestra.run.smithi197.stderr: 68200K .......... .......... .......... .......... .......... 73% 104M 0s 2020-04-28T12:42:07.389 INFO:teuthology.orchestra.run.smithi197.stderr: 68250K .......... .......... .......... .......... .......... 73% 136M 0s 2020-04-28T12:42:07.389 INFO:teuthology.orchestra.run.smithi197.stderr: 68300K .......... .......... .......... .......... .......... 73% 108M 0s 2020-04-28T12:42:07.389 INFO:teuthology.orchestra.run.smithi197.stderr: 68350K .......... .......... .......... .......... .......... 73% 91.3M 0s 2020-04-28T12:42:07.389 INFO:teuthology.orchestra.run.smithi197.stderr: 68400K .......... .......... .......... .......... .......... 73% 111M 0s 2020-04-28T12:42:07.389 INFO:teuthology.orchestra.run.smithi197.stderr: 68450K .......... .......... .......... .......... .......... 73% 111M 0s 2020-04-28T12:42:07.389 INFO:teuthology.orchestra.run.smithi197.stderr: 68500K .......... .......... .......... .......... .......... 73% 127M 0s 2020-04-28T12:42:07.390 INFO:teuthology.orchestra.run.smithi197.stderr: 68550K .......... .......... .......... .......... .......... 73% 112M 0s 2020-04-28T12:42:07.390 INFO:teuthology.orchestra.run.smithi197.stderr: 68600K .......... .......... .......... .......... .......... 73% 112M 0s 2020-04-28T12:42:07.390 INFO:teuthology.orchestra.run.smithi197.stderr: 68650K .......... .......... .......... .......... .......... 73% 125M 0s 2020-04-28T12:42:07.390 INFO:teuthology.orchestra.run.smithi197.stderr: 68700K .......... .......... .......... .......... .......... 74% 112M 0s 2020-04-28T12:42:07.390 INFO:teuthology.orchestra.run.smithi197.stderr: 68750K .......... .......... .......... .......... .......... 74% 91.0M 0s 2020-04-28T12:42:07.390 INFO:teuthology.orchestra.run.smithi197.stderr: 68800K .......... .......... .......... .......... .......... 74% 111M 0s 2020-04-28T12:42:07.390 INFO:teuthology.orchestra.run.smithi197.stderr: 68850K .......... .......... .......... .......... .......... 74% 115M 0s 2020-04-28T12:42:07.391 INFO:teuthology.orchestra.run.smithi197.stderr: 68900K .......... .......... .......... .......... .......... 74% 110M 0s 2020-04-28T12:42:07.391 INFO:teuthology.orchestra.run.smithi197.stderr: 68950K .......... .......... .......... .......... .......... 74% 104M 0s 2020-04-28T12:42:07.391 INFO:teuthology.orchestra.run.smithi197.stderr: 69000K .......... .......... .......... .......... .......... 74% 106M 0s 2020-04-28T12:42:07.391 INFO:teuthology.orchestra.run.smithi197.stderr: 69050K .......... .......... .......... .......... .......... 74% 116M 0s 2020-04-28T12:42:07.391 INFO:teuthology.orchestra.run.smithi197.stderr: 69100K .......... .......... .......... .......... .......... 74% 104M 0s 2020-04-28T12:42:07.391 INFO:teuthology.orchestra.run.smithi197.stderr: 69150K .......... .......... .......... .......... .......... 74% 92.7M 0s 2020-04-28T12:42:07.391 INFO:teuthology.orchestra.run.smithi197.stderr: 69200K .......... .......... .......... .......... .......... 74% 109M 0s 2020-04-28T12:42:07.392 INFO:teuthology.orchestra.run.smithi197.stderr: 69250K .......... .......... .......... .......... .......... 74% 108M 0s 2020-04-28T12:42:07.392 INFO:teuthology.orchestra.run.smithi197.stderr: 69300K .......... .......... .......... .......... .......... 74% 126M 0s 2020-04-28T12:42:07.392 INFO:teuthology.orchestra.run.smithi197.stderr: 69350K .......... .......... .......... .......... .......... 74% 106M 0s 2020-04-28T12:42:07.392 INFO:teuthology.orchestra.run.smithi197.stderr: 69400K .......... .......... .......... .......... .......... 74% 114M 0s 2020-04-28T12:42:07.392 INFO:teuthology.orchestra.run.smithi197.stderr: 69450K .......... .......... .......... .......... .......... 74% 121M 0s 2020-04-28T12:42:07.392 INFO:teuthology.orchestra.run.smithi197.stderr: 69500K .......... .......... .......... .......... .......... 74% 112M 0s 2020-04-28T12:42:07.392 INFO:teuthology.orchestra.run.smithi197.stderr: 69550K .......... .......... .......... .......... .......... 74% 88.3M 0s 2020-04-28T12:42:07.393 INFO:teuthology.orchestra.run.smithi197.stderr: 69600K .......... .......... .......... .......... .......... 74% 109M 0s 2020-04-28T12:42:07.393 INFO:teuthology.orchestra.run.smithi197.stderr: 69650K .......... .......... .......... .......... .......... 75% 116M 0s 2020-04-28T12:42:07.393 INFO:teuthology.orchestra.run.smithi197.stderr: 69700K .......... .......... .......... .......... .......... 75% 117M 0s 2020-04-28T12:42:07.393 INFO:teuthology.orchestra.run.smithi197.stderr: 69750K .......... .......... .......... .......... .......... 75% 116M 0s 2020-04-28T12:42:07.393 INFO:teuthology.orchestra.run.smithi197.stderr: 69800K .......... .......... .......... .......... .......... 75% 117M 0s 2020-04-28T12:42:07.393 INFO:teuthology.orchestra.run.smithi197.stderr: 69850K .......... .......... .......... .......... .......... 75% 113M 0s 2020-04-28T12:42:07.393 INFO:teuthology.orchestra.run.smithi197.stderr: 69900K .......... .......... .......... .......... .......... 75% 122M 0s 2020-04-28T12:42:07.394 INFO:teuthology.orchestra.run.smithi197.stderr: 69950K .......... .......... .......... .......... .......... 75% 86.3M 0s 2020-04-28T12:42:07.394 INFO:teuthology.orchestra.run.smithi197.stderr: 70000K .......... .......... .......... .......... .......... 75% 122M 0s 2020-04-28T12:42:07.394 INFO:teuthology.orchestra.run.smithi197.stderr: 70050K .......... .......... .......... .......... .......... 75% 111M 0s 2020-04-28T12:42:07.394 INFO:teuthology.orchestra.run.smithi197.stderr: 70100K .......... .......... .......... .......... .......... 75% 120M 0s 2020-04-28T12:42:07.394 INFO:teuthology.orchestra.run.smithi197.stderr: 70150K .......... .......... .......... .......... .......... 75% 112M 0s 2020-04-28T12:42:07.394 INFO:teuthology.orchestra.run.smithi197.stderr: 70200K .......... .......... .......... .......... .......... 75% 118M 0s 2020-04-28T12:42:07.394 INFO:teuthology.orchestra.run.smithi197.stderr: 70250K .......... .......... .......... .......... .......... 75% 115M 0s 2020-04-28T12:42:07.395 INFO:teuthology.orchestra.run.smithi197.stderr: 70300K .......... .......... .......... .......... .......... 75% 120M 0s 2020-04-28T12:42:07.395 INFO:teuthology.orchestra.run.smithi197.stderr: 70350K .......... .......... .......... .......... .......... 75% 87.3M 0s 2020-04-28T12:42:07.395 INFO:teuthology.orchestra.run.smithi197.stderr: 70400K .......... .......... .......... .......... .......... 75% 110M 0s 2020-04-28T12:42:07.395 INFO:teuthology.orchestra.run.smithi197.stderr: 70450K .......... .......... .......... .......... .......... 75% 126M 0s 2020-04-28T12:42:07.395 INFO:teuthology.orchestra.run.smithi197.stderr: 70500K .......... .......... .......... .......... .......... 75% 114M 0s 2020-04-28T12:42:07.395 INFO:teuthology.orchestra.run.smithi197.stderr: 70550K .......... .......... .......... .......... .......... 75% 111M 0s 2020-04-28T12:42:07.395 INFO:teuthology.orchestra.run.smithi197.stderr: 70600K .......... .......... .......... .......... .......... 76% 116M 0s 2020-04-28T12:42:07.396 INFO:teuthology.orchestra.run.smithi197.stderr: 70650K .......... .......... .......... .......... .......... 76% 114M 0s 2020-04-28T12:42:07.396 INFO:teuthology.orchestra.run.smithi197.stderr: 70700K .......... .......... .......... .......... .......... 76% 121M 0s 2020-04-28T12:42:07.396 INFO:teuthology.orchestra.run.smithi197.stderr: 70750K .......... .......... .......... .......... .......... 76% 88.5M 0s 2020-04-28T12:42:07.396 INFO:teuthology.orchestra.run.smithi197.stderr: 70800K .......... .......... .......... .......... .......... 76% 115M 0s 2020-04-28T12:42:07.396 INFO:teuthology.orchestra.run.smithi197.stderr: 70850K .......... .......... .......... .......... .......... 76% 101M 0s 2020-04-28T12:42:07.396 INFO:teuthology.orchestra.run.smithi197.stderr: 70900K .......... .......... .......... .......... .......... 76% 128M 0s 2020-04-28T12:42:07.396 INFO:teuthology.orchestra.run.smithi197.stderr: 70950K .......... .......... .......... .......... .......... 76% 118M 0s 2020-04-28T12:42:07.397 INFO:teuthology.orchestra.run.smithi197.stderr: 71000K .......... .......... .......... .......... .......... 76% 117M 0s 2020-04-28T12:42:07.397 INFO:teuthology.orchestra.run.smithi197.stderr: 71050K .......... .......... .......... .......... .......... 76% 118M 0s 2020-04-28T12:42:07.397 INFO:teuthology.orchestra.run.smithi197.stderr: 71100K .......... .......... .......... .......... .......... 76% 116M 0s 2020-04-28T12:42:07.397 INFO:teuthology.orchestra.run.smithi197.stderr: 71150K .......... .......... .......... .......... .......... 76% 87.6M 0s 2020-04-28T12:42:07.397 INFO:teuthology.orchestra.run.smithi197.stderr: 71200K .......... .......... .......... .......... .......... 76% 119M 0s 2020-04-28T12:42:07.398 INFO:teuthology.orchestra.run.smithi197.stderr: 71250K .......... .......... .......... .......... .......... 76% 111M 0s 2020-04-28T12:42:07.398 INFO:teuthology.orchestra.run.smithi197.stderr: 71300K .......... .......... .......... .......... .......... 76% 115M 0s 2020-04-28T12:42:07.398 INFO:teuthology.orchestra.run.smithi197.stderr: 71350K .......... .......... .......... .......... .......... 76% 113M 0s 2020-04-28T12:42:07.398 INFO:teuthology.orchestra.run.smithi197.stderr: 71400K .......... .......... .......... .......... .......... 76% 120M 0s 2020-04-28T12:42:07.398 INFO:teuthology.orchestra.run.smithi197.stderr: 71450K .......... .......... .......... .......... .......... 76% 114M 0s 2020-04-28T12:42:07.398 INFO:teuthology.orchestra.run.smithi197.stderr: 71500K .......... .......... .......... .......... .......... 77% 117M 0s 2020-04-28T12:42:07.398 INFO:teuthology.orchestra.run.smithi197.stderr: 71550K .......... .......... .......... .......... .......... 77% 87.7M 0s 2020-04-28T12:42:07.399 INFO:teuthology.orchestra.run.smithi197.stderr: 71600K .......... .......... .......... .......... .......... 77% 119M 0s 2020-04-28T12:42:07.399 INFO:teuthology.orchestra.run.smithi197.stderr: 71650K .......... .......... .......... .......... .......... 77% 120M 0s 2020-04-28T12:42:07.399 INFO:teuthology.orchestra.run.smithi197.stderr: 71700K .......... .......... .......... .......... .......... 77% 93.2M 0s 2020-04-28T12:42:07.399 INFO:teuthology.orchestra.run.smithi197.stderr: 71750K .......... .......... .......... .......... .......... 77% 110M 0s 2020-04-28T12:42:07.399 INFO:teuthology.orchestra.run.smithi197.stderr: 71800K .......... .......... .......... .......... .......... 77% 111M 0s 2020-04-28T12:42:07.399 INFO:teuthology.orchestra.run.smithi197.stderr: 71850K .......... .......... .......... .......... .......... 77% 114M 0s 2020-04-28T12:42:07.399 INFO:teuthology.orchestra.run.smithi197.stderr: 71900K .......... .......... .......... .......... .......... 77% 123M 0s 2020-04-28T12:42:07.400 INFO:teuthology.orchestra.run.smithi197.stderr: 71950K .......... .......... .......... .......... .......... 77% 88.2M 0s 2020-04-28T12:42:07.400 INFO:teuthology.orchestra.run.smithi197.stderr: 72000K .......... .......... .......... .......... .......... 77% 117M 0s 2020-04-28T12:42:07.400 INFO:teuthology.orchestra.run.smithi197.stderr: 72050K .......... .......... .......... .......... .......... 77% 113M 0s 2020-04-28T12:42:07.400 INFO:teuthology.orchestra.run.smithi197.stderr: 72100K .......... .......... .......... .......... .......... 77% 117M 0s 2020-04-28T12:42:07.400 INFO:teuthology.orchestra.run.smithi197.stderr: 72150K .......... .......... .......... .......... .......... 77% 111M 0s 2020-04-28T12:42:07.400 INFO:teuthology.orchestra.run.smithi197.stderr: 72200K .......... .......... .......... .......... .......... 77% 101M 0s 2020-04-28T12:42:07.400 INFO:teuthology.orchestra.run.smithi197.stderr: 72250K .......... .......... .......... .......... .......... 77% 131M 0s 2020-04-28T12:42:07.401 INFO:teuthology.orchestra.run.smithi197.stderr: 72300K .......... .......... .......... .......... .......... 77% 123M 0s 2020-04-28T12:42:07.401 INFO:teuthology.orchestra.run.smithi197.stderr: 72350K .......... .......... .......... .......... .......... 77% 89.2M 0s 2020-04-28T12:42:07.401 INFO:teuthology.orchestra.run.smithi197.stderr: 72400K .......... .......... .......... .......... .......... 77% 117M 0s 2020-04-28T12:42:07.401 INFO:teuthology.orchestra.run.smithi197.stderr: 72450K .......... .......... .......... .......... .......... 78% 119M 0s 2020-04-28T12:42:07.401 INFO:teuthology.orchestra.run.smithi197.stderr: 72500K .......... .......... .......... .......... .......... 78% 93.9M 0s 2020-04-28T12:42:07.401 INFO:teuthology.orchestra.run.smithi197.stderr: 72550K .......... .......... .......... .......... .......... 78% 110M 0s 2020-04-28T12:42:07.401 INFO:teuthology.orchestra.run.smithi197.stderr: 72600K .......... .......... .......... .......... .......... 78% 116M 0s 2020-04-28T12:42:07.402 INFO:teuthology.orchestra.run.smithi197.stderr: 72650K .......... .......... .......... .......... .......... 78% 115M 0s 2020-04-28T12:42:07.402 INFO:teuthology.orchestra.run.smithi197.stderr: 72700K .......... .......... .......... .......... .......... 78% 116M 0s 2020-04-28T12:42:07.402 INFO:teuthology.orchestra.run.smithi197.stderr: 72750K .......... .......... .......... .......... .......... 78% 89.2M 0s 2020-04-28T12:42:07.402 INFO:teuthology.orchestra.run.smithi197.stderr: 72800K .......... .......... .......... .......... .......... 78% 117M 0s 2020-04-28T12:42:07.402 INFO:teuthology.orchestra.run.smithi197.stderr: 72850K .......... .......... .......... .......... .......... 78% 119M 0s 2020-04-28T12:42:07.402 INFO:teuthology.orchestra.run.smithi197.stderr: 72900K .......... .......... .......... .......... .......... 78% 116M 0s 2020-04-28T12:42:07.402 INFO:teuthology.orchestra.run.smithi197.stderr: 72950K .......... .......... .......... .......... .......... 78% 110M 0s 2020-04-28T12:42:07.403 INFO:teuthology.orchestra.run.smithi197.stderr: 73000K .......... .......... .......... .......... .......... 78% 120M 0s 2020-04-28T12:42:07.403 INFO:teuthology.orchestra.run.smithi197.stderr: 73050K .......... .......... .......... .......... .......... 78% 117M 0s 2020-04-28T12:42:07.403 INFO:teuthology.orchestra.run.smithi197.stderr: 73100K .......... .......... .......... .......... .......... 78% 119M 0s 2020-04-28T12:42:07.403 INFO:teuthology.orchestra.run.smithi197.stderr: 73150K .......... .......... .......... .......... .......... 78% 88.2M 0s 2020-04-28T12:42:07.403 INFO:teuthology.orchestra.run.smithi197.stderr: 73200K .......... .......... .......... .......... .......... 78% 119M 0s 2020-04-28T12:42:07.403 INFO:teuthology.orchestra.run.smithi197.stderr: 73250K .......... .......... .......... .......... .......... 78% 116M 0s 2020-04-28T12:42:07.403 INFO:teuthology.orchestra.run.smithi197.stderr: 73300K .......... .......... .......... .......... .......... 78% 115M 0s 2020-04-28T12:42:07.404 INFO:teuthology.orchestra.run.smithi197.stderr: 73350K .......... .......... .......... .......... .......... 79% 112M 0s 2020-04-28T12:42:07.404 INFO:teuthology.orchestra.run.smithi197.stderr: 73400K .......... .......... .......... .......... .......... 79% 109M 0s 2020-04-28T12:42:07.404 INFO:teuthology.orchestra.run.smithi197.stderr: 73450K .......... .......... .......... .......... .......... 79% 119M 0s 2020-04-28T12:42:07.404 INFO:teuthology.orchestra.run.smithi197.stderr: 73500K .......... .......... .......... .......... .......... 79% 110M 0s 2020-04-28T12:42:07.404 INFO:teuthology.orchestra.run.smithi197.stderr: 73550K .......... .......... .......... .......... .......... 79% 94.2M 0s 2020-04-28T12:42:07.404 INFO:teuthology.orchestra.run.smithi197.stderr: 73600K .......... .......... .......... .......... .......... 79% 120M 0s 2020-04-28T12:42:07.404 INFO:teuthology.orchestra.run.smithi197.stderr: 73650K .......... .......... .......... .......... .......... 79% 117M 0s 2020-04-28T12:42:07.405 INFO:teuthology.orchestra.run.smithi197.stderr: 73700K .......... .......... .......... .......... .......... 79% 116M 0s 2020-04-28T12:42:07.405 INFO:teuthology.orchestra.run.smithi197.stderr: 73750K .......... .......... .......... .......... .......... 79% 114M 0s 2020-04-28T12:42:07.405 INFO:teuthology.orchestra.run.smithi197.stderr: 73800K .......... .......... .......... .......... .......... 79% 108M 0s 2020-04-28T12:42:07.405 INFO:teuthology.orchestra.run.smithi197.stderr: 73850K .......... .......... .......... .......... .......... 79% 122M 0s 2020-04-28T12:42:07.405 INFO:teuthology.orchestra.run.smithi197.stderr: 73900K .......... .......... .......... .......... .......... 79% 114M 0s 2020-04-28T12:42:07.405 INFO:teuthology.orchestra.run.smithi197.stderr: 73950K .......... .......... .......... .......... .......... 79% 86.0M 0s 2020-04-28T12:42:07.405 INFO:teuthology.orchestra.run.smithi197.stderr: 74000K .......... .......... .......... .......... .......... 79% 119M 0s 2020-04-28T12:42:07.406 INFO:teuthology.orchestra.run.smithi197.stderr: 74050K .......... .......... .......... .......... .......... 79% 113M 0s 2020-04-28T12:42:07.406 INFO:teuthology.orchestra.run.smithi197.stderr: 74100K .......... .......... .......... .......... .......... 79% 117M 0s 2020-04-28T12:42:07.406 INFO:teuthology.orchestra.run.smithi197.stderr: 74150K .......... .......... .......... .......... .......... 79% 114M 0s 2020-04-28T12:42:07.406 INFO:teuthology.orchestra.run.smithi197.stderr: 74200K .......... .......... .......... .......... .......... 79% 120M 0s 2020-04-28T12:42:07.406 INFO:teuthology.orchestra.run.smithi197.stderr: 74250K .......... .......... .......... .......... .......... 79% 114M 0s 2020-04-28T12:42:07.406 INFO:teuthology.orchestra.run.smithi197.stderr: 74300K .......... .......... .......... .......... .......... 80% 114M 0s 2020-04-28T12:42:07.406 INFO:teuthology.orchestra.run.smithi197.stderr: 74350K .......... .......... .......... .......... .......... 80% 91.6M 0s 2020-04-28T12:42:07.407 INFO:teuthology.orchestra.run.smithi197.stderr: 74400K .......... .......... .......... .......... .......... 80% 115M 0s 2020-04-28T12:42:07.407 INFO:teuthology.orchestra.run.smithi197.stderr: 74450K .......... .......... .......... .......... .......... 80% 117M 0s 2020-04-28T12:42:07.407 INFO:teuthology.orchestra.run.smithi197.stderr: 74500K .......... .......... .......... .......... .......... 80% 122M 0s 2020-04-28T12:42:07.407 INFO:teuthology.orchestra.run.smithi197.stderr: 74550K .......... .......... .......... .......... .......... 80% 111M 0s 2020-04-28T12:42:07.407 INFO:teuthology.orchestra.run.smithi197.stderr: 74600K .......... .......... .......... .......... .......... 80% 118M 0s 2020-04-28T12:42:07.407 INFO:teuthology.orchestra.run.smithi197.stderr: 74650K .......... .......... .......... .......... .......... 80% 115M 0s 2020-04-28T12:42:07.407 INFO:teuthology.orchestra.run.smithi197.stderr: 74700K .......... .......... .......... .......... .......... 80% 113M 0s 2020-04-28T12:42:07.408 INFO:teuthology.orchestra.run.smithi197.stderr: 74750K .......... .......... .......... .......... .......... 80% 90.3M 0s 2020-04-28T12:42:07.408 INFO:teuthology.orchestra.run.smithi197.stderr: 74800K .......... .......... .......... .......... .......... 80% 114M 0s 2020-04-28T12:42:07.408 INFO:teuthology.orchestra.run.smithi197.stderr: 74850K .......... .......... .......... .......... .......... 80% 114M 0s 2020-04-28T12:42:07.408 INFO:teuthology.orchestra.run.smithi197.stderr: 74900K .......... .......... .......... .......... .......... 80% 118M 0s 2020-04-28T12:42:07.408 INFO:teuthology.orchestra.run.smithi197.stderr: 74950K .......... .......... .......... .......... .......... 80% 102M 0s 2020-04-28T12:42:07.408 INFO:teuthology.orchestra.run.smithi197.stderr: 75000K .......... .......... .......... .......... .......... 80% 123M 0s 2020-04-28T12:42:07.409 INFO:teuthology.orchestra.run.smithi197.stderr: 75050K .......... .......... .......... .......... .......... 80% 115M 0s 2020-04-28T12:42:07.409 INFO:teuthology.orchestra.run.smithi197.stderr: 75100K .......... .......... .......... .......... .......... 80% 115M 0s 2020-04-28T12:42:07.409 INFO:teuthology.orchestra.run.smithi197.stderr: 75150K .......... .......... .......... .......... .......... 80% 85.6M 0s 2020-04-28T12:42:07.409 INFO:teuthology.orchestra.run.smithi197.stderr: 75200K .......... .......... .......... .......... .......... 81% 125M 0s 2020-04-28T12:42:07.409 INFO:teuthology.orchestra.run.smithi197.stderr: 75250K .......... .......... .......... .......... .......... 81% 116M 0s 2020-04-28T12:42:07.409 INFO:teuthology.orchestra.run.smithi197.stderr: 75300K .......... .......... .......... .......... .......... 81% 107M 0s 2020-04-28T12:42:07.409 INFO:teuthology.orchestra.run.smithi197.stderr: 75350K .......... .......... .......... .......... .......... 81% 97.7M 0s 2020-04-28T12:42:07.410 INFO:teuthology.orchestra.run.smithi197.stderr: 75400K .......... .......... .......... .......... .......... 81% 150M 0s 2020-04-28T12:42:07.410 INFO:teuthology.orchestra.run.smithi197.stderr: 75450K .......... .......... .......... .......... .......... 81% 117M 0s 2020-04-28T12:42:07.410 INFO:teuthology.orchestra.run.smithi197.stderr: 75500K .......... .......... .......... .......... .......... 81% 115M 0s 2020-04-28T12:42:07.410 INFO:teuthology.orchestra.run.smithi197.stderr: 75550K .......... .......... .......... .......... .......... 81% 88.3M 0s 2020-04-28T12:42:07.410 INFO:teuthology.orchestra.run.smithi197.stderr: 75600K .......... .......... .......... .......... .......... 81% 116M 0s 2020-04-28T12:42:07.410 INFO:teuthology.orchestra.run.smithi197.stderr: 75650K .......... .......... .......... .......... .......... 81% 121M 0s 2020-04-28T12:42:07.410 INFO:teuthology.orchestra.run.smithi197.stderr: 75700K .......... .......... .......... .......... .......... 81% 118M 0s 2020-04-28T12:42:07.411 INFO:teuthology.orchestra.run.smithi197.stderr: 75750K .......... .......... .......... .......... .......... 81% 110M 0s 2020-04-28T12:42:07.411 INFO:teuthology.orchestra.run.smithi197.stderr: 75800K .......... .......... .......... .......... .......... 81% 99.0M 0s 2020-04-28T12:42:07.411 INFO:teuthology.orchestra.run.smithi197.stderr: 75850K .......... .......... .......... .......... .......... 81% 130M 0s 2020-04-28T12:42:07.411 INFO:teuthology.orchestra.run.smithi197.stderr: 75900K .......... .......... .......... .......... .......... 81% 120M 0s 2020-04-28T12:42:07.411 INFO:teuthology.orchestra.run.smithi197.stderr: 75950K .......... .......... .......... .......... .......... 81% 91.4M 0s 2020-04-28T12:42:07.411 INFO:teuthology.orchestra.run.smithi197.stderr: 76000K .......... .......... .......... .......... .......... 81% 101M 0s 2020-04-28T12:42:07.411 INFO:teuthology.orchestra.run.smithi197.stderr: 76050K .......... .......... .......... .......... .......... 81% 136M 0s 2020-04-28T12:42:07.412 INFO:teuthology.orchestra.run.smithi197.stderr: 76100K .......... .......... .......... .......... .......... 81% 116M 0s 2020-04-28T12:42:07.412 INFO:teuthology.orchestra.run.smithi197.stderr: 76150K .......... .......... .......... .......... .......... 82% 123M 0s 2020-04-28T12:42:07.412 INFO:teuthology.orchestra.run.smithi197.stderr: 76200K .......... .......... .......... .......... .......... 82% 113M 0s 2020-04-28T12:42:07.412 INFO:teuthology.orchestra.run.smithi197.stderr: 76250K .......... .......... .......... .......... .......... 82% 118M 0s 2020-04-28T12:42:07.412 INFO:teuthology.orchestra.run.smithi197.stderr: 76300K .......... .......... .......... .......... .......... 82% 109M 0s 2020-04-28T12:42:07.412 INFO:teuthology.orchestra.run.smithi197.stderr: 76350K .......... .......... .......... .......... .......... 82% 95.6M 0s 2020-04-28T12:42:07.413 INFO:teuthology.orchestra.run.smithi197.stderr: 76400K .......... .......... .......... .......... .......... 82% 113M 0s 2020-04-28T12:42:07.413 INFO:teuthology.orchestra.run.smithi197.stderr: 76450K .......... .......... .......... .......... .......... 82% 116M 0s 2020-04-28T12:42:07.413 INFO:teuthology.orchestra.run.smithi197.stderr: 76500K .......... .......... .......... .......... .......... 82% 114M 0s 2020-04-28T12:42:07.413 INFO:teuthology.orchestra.run.smithi197.stderr: 76550K .......... .......... .......... .......... .......... 82% 116M 0s 2020-04-28T12:42:07.413 INFO:teuthology.orchestra.run.smithi197.stderr: 76600K .......... .......... .......... .......... .......... 82% 120M 0s 2020-04-28T12:42:07.413 INFO:teuthology.orchestra.run.smithi197.stderr: 76650K .......... .......... .......... .......... .......... 82% 114M 0s 2020-04-28T12:42:07.413 INFO:teuthology.orchestra.run.smithi197.stderr: 76700K .......... .......... .......... .......... .......... 82% 117M 0s 2020-04-28T12:42:07.414 INFO:teuthology.orchestra.run.smithi197.stderr: 76750K .......... .......... .......... .......... .......... 82% 87.5M 0s 2020-04-28T12:42:07.414 INFO:teuthology.orchestra.run.smithi197.stderr: 76800K .......... .......... .......... .......... .......... 82% 117M 0s 2020-04-28T12:42:07.414 INFO:teuthology.orchestra.run.smithi197.stderr: 76850K .......... .......... .......... .......... .......... 82% 115M 0s 2020-04-28T12:42:07.414 INFO:teuthology.orchestra.run.smithi197.stderr: 76900K .......... .......... .......... .......... .......... 82% 113M 0s 2020-04-28T12:42:07.414 INFO:teuthology.orchestra.run.smithi197.stderr: 76950K .......... .......... .......... .......... .......... 82% 112M 0s 2020-04-28T12:42:07.414 INFO:teuthology.orchestra.run.smithi197.stderr: 77000K .......... .......... .......... .......... .......... 82% 120M 0s 2020-04-28T12:42:07.414 INFO:teuthology.orchestra.run.smithi197.stderr: 77050K .......... .......... .......... .......... .......... 82% 98.8M 0s 2020-04-28T12:42:07.415 INFO:teuthology.orchestra.run.smithi197.stderr: 77100K .......... .......... .......... .......... .......... 83% 116M 0s 2020-04-28T12:42:07.415 INFO:teuthology.orchestra.run.smithi197.stderr: 77150K .......... .......... .......... .......... .......... 83% 88.0M 0s 2020-04-28T12:42:07.415 INFO:teuthology.orchestra.run.smithi197.stderr: 77200K .......... .......... .......... .......... .......... 83% 115M 0s 2020-04-28T12:42:07.415 INFO:teuthology.orchestra.run.smithi197.stderr: 77250K .......... .......... .......... .......... .......... 83% 107M 0s 2020-04-28T12:42:07.415 INFO:teuthology.orchestra.run.smithi197.stderr: 77300K .......... .......... .......... .......... .......... 83% 135M 0s 2020-04-28T12:42:07.415 INFO:teuthology.orchestra.run.smithi197.stderr: 77350K .......... .......... .......... .......... .......... 83% 118M 0s 2020-04-28T12:42:07.415 INFO:teuthology.orchestra.run.smithi197.stderr: 77400K .......... .......... .......... .......... .......... 83% 116M 0s 2020-04-28T12:42:07.416 INFO:teuthology.orchestra.run.smithi197.stderr: 77450K .......... .......... .......... .......... .......... 83% 117M 0s 2020-04-28T12:42:07.416 INFO:teuthology.orchestra.run.smithi197.stderr: 77500K .......... .......... .......... .......... .......... 83% 113M 0s 2020-04-28T12:42:07.416 INFO:teuthology.orchestra.run.smithi197.stderr: 77550K .......... .......... .......... .......... .......... 83% 93.6M 0s 2020-04-28T12:42:07.416 INFO:teuthology.orchestra.run.smithi197.stderr: 77600K .......... .......... .......... .......... .......... 83% 114M 0s 2020-04-28T12:42:07.416 INFO:teuthology.orchestra.run.smithi197.stderr: 77650K .......... .......... .......... .......... .......... 83% 110M 0s 2020-04-28T12:42:07.416 INFO:teuthology.orchestra.run.smithi197.stderr: 77700K .......... .......... .......... .......... .......... 83% 113M 0s 2020-04-28T12:42:07.416 INFO:teuthology.orchestra.run.smithi197.stderr: 77750K .......... .......... .......... .......... .......... 83% 115M 0s 2020-04-28T12:42:07.417 INFO:teuthology.orchestra.run.smithi197.stderr: 77800K .......... .......... .......... .......... .......... 83% 113M 0s 2020-04-28T12:42:07.417 INFO:teuthology.orchestra.run.smithi197.stderr: 77850K .......... .......... .......... .......... .......... 83% 122M 0s 2020-04-28T12:42:07.417 INFO:teuthology.orchestra.run.smithi197.stderr: 77900K .......... .......... .......... .......... .......... 83% 106M 0s 2020-04-28T12:42:07.417 INFO:teuthology.orchestra.run.smithi197.stderr: 77950K .......... .......... .......... .......... .......... 83% 78.1M 0s 2020-04-28T12:42:07.417 INFO:teuthology.orchestra.run.smithi197.stderr: 78000K .......... .......... .......... .......... .......... 84% 122M 0s 2020-04-28T12:42:07.417 INFO:teuthology.orchestra.run.smithi197.stderr: 78050K .......... .......... .......... .......... .......... 84% 114M 0s 2020-04-28T12:42:07.417 INFO:teuthology.orchestra.run.smithi197.stderr: 78100K .......... .......... .......... .......... .......... 84% 106M 0s 2020-04-28T12:42:07.418 INFO:teuthology.orchestra.run.smithi197.stderr: 78150K .......... .......... .......... .......... .......... 84% 126M 0s 2020-04-28T12:42:07.418 INFO:teuthology.orchestra.run.smithi197.stderr: 78200K .......... .......... .......... .......... .......... 84% 124M 0s 2020-04-28T12:42:07.418 INFO:teuthology.orchestra.run.smithi197.stderr: 78250K .......... .......... .......... .......... .......... 84% 126M 0s 2020-04-28T12:42:07.418 INFO:teuthology.orchestra.run.smithi197.stderr: 78300K .......... .......... .......... .......... .......... 84% 117M 0s 2020-04-28T12:42:07.418 INFO:teuthology.orchestra.run.smithi197.stderr: 78350K .......... .......... .......... .......... .......... 84% 84.2M 0s 2020-04-28T12:42:07.418 INFO:teuthology.orchestra.run.smithi197.stderr: 78400K .......... .......... .......... .......... .......... 84% 114M 0s 2020-04-28T12:42:07.418 INFO:teuthology.orchestra.run.smithi197.stderr: 78450K .......... .......... .......... .......... .......... 84% 109M 0s 2020-04-28T12:42:07.419 INFO:teuthology.orchestra.run.smithi197.stderr: 78500K .......... .......... .......... .......... .......... 84% 132M 0s 2020-04-28T12:42:07.419 INFO:teuthology.orchestra.run.smithi197.stderr: 78550K .......... .......... .......... .......... .......... 84% 108M 0s 2020-04-28T12:42:07.419 INFO:teuthology.orchestra.run.smithi197.stderr: 78600K .......... .......... .......... .......... .......... 84% 118M 0s 2020-04-28T12:42:07.419 INFO:teuthology.orchestra.run.smithi197.stderr: 78650K .......... .......... .......... .......... .......... 84% 119M 0s 2020-04-28T12:42:07.419 INFO:teuthology.orchestra.run.smithi197.stderr: 78700K .......... .......... .......... .......... .......... 84% 116M 0s 2020-04-28T12:42:07.419 INFO:teuthology.orchestra.run.smithi197.stderr: 78750K .......... .......... .......... .......... .......... 84% 89.0M 0s 2020-04-28T12:42:07.419 INFO:teuthology.orchestra.run.smithi197.stderr: 78800K .......... .......... .......... .......... .......... 84% 108M 0s 2020-04-28T12:42:07.420 INFO:teuthology.orchestra.run.smithi197.stderr: 78850K .......... .......... .......... .......... .......... 84% 123M 0s 2020-04-28T12:42:07.420 INFO:teuthology.orchestra.run.smithi197.stderr: 78900K .......... .......... .......... .......... .......... 84% 108M 0s 2020-04-28T12:42:07.420 INFO:teuthology.orchestra.run.smithi197.stderr: 78950K .......... .......... .......... .......... .......... 85% 109M 0s 2020-04-28T12:42:07.420 INFO:teuthology.orchestra.run.smithi197.stderr: 79000K .......... .......... .......... .......... .......... 85% 119M 0s 2020-04-28T12:42:07.420 INFO:teuthology.orchestra.run.smithi197.stderr: 79050K .......... .......... .......... .......... .......... 85% 113M 0s 2020-04-28T12:42:07.420 INFO:teuthology.orchestra.run.smithi197.stderr: 79100K .......... .......... .......... .......... .......... 85% 107M 0s 2020-04-28T12:42:07.420 INFO:teuthology.orchestra.run.smithi197.stderr: 79150K .......... .......... .......... .......... .......... 85% 91.2M 0s 2020-04-28T12:42:07.421 INFO:teuthology.orchestra.run.smithi197.stderr: 79200K .......... .......... .......... .......... .......... 85% 120M 0s 2020-04-28T12:42:07.421 INFO:teuthology.orchestra.run.smithi197.stderr: 79250K .......... .......... .......... .......... .......... 85% 121M 0s 2020-04-28T12:42:07.421 INFO:teuthology.orchestra.run.smithi197.stderr: 79300K .......... .......... .......... .......... .......... 85% 115M 0s 2020-04-28T12:42:07.421 INFO:teuthology.orchestra.run.smithi197.stderr: 79350K .......... .......... .......... .......... .......... 85% 106M 0s 2020-04-28T12:42:07.421 INFO:teuthology.orchestra.run.smithi197.stderr: 79400K .......... .......... .......... .......... .......... 85% 109M 0s 2020-04-28T12:42:07.421 INFO:teuthology.orchestra.run.smithi197.stderr: 79450K .......... .......... .......... .......... .......... 85% 132M 0s 2020-04-28T12:42:07.421 INFO:teuthology.orchestra.run.smithi197.stderr: 79500K .......... .......... .......... .......... .......... 85% 116M 0s 2020-04-28T12:42:07.422 INFO:teuthology.orchestra.run.smithi197.stderr: 79550K .......... .......... .......... .......... .......... 85% 88.9M 0s 2020-04-28T12:42:07.422 INFO:teuthology.orchestra.run.smithi197.stderr: 79600K .......... .......... .......... .......... .......... 85% 114M 0s 2020-04-28T12:42:07.422 INFO:teuthology.orchestra.run.smithi197.stderr: 79650K .......... .......... .......... .......... .......... 85% 110M 0s 2020-04-28T12:42:07.422 INFO:teuthology.orchestra.run.smithi197.stderr: 79700K .......... .......... .......... .......... .......... 85% 95.1M 0s 2020-04-28T12:42:07.422 INFO:teuthology.orchestra.run.smithi197.stderr: 79750K .......... .......... .......... .......... .......... 85% 121M 0s 2020-04-28T12:42:07.422 INFO:teuthology.orchestra.run.smithi197.stderr: 79800K .......... .......... .......... .......... .......... 85% 136M 0s 2020-04-28T12:42:07.422 INFO:teuthology.orchestra.run.smithi197.stderr: 79850K .......... .......... .......... .......... .......... 86% 108M 0s 2020-04-28T12:42:07.423 INFO:teuthology.orchestra.run.smithi197.stderr: 79900K .......... .......... .......... .......... .......... 86% 115M 0s 2020-04-28T12:42:07.423 INFO:teuthology.orchestra.run.smithi197.stderr: 79950K .......... .......... .......... .......... .......... 86% 85.0M 0s 2020-04-28T12:42:07.423 INFO:teuthology.orchestra.run.smithi197.stderr: 80000K .......... .......... .......... .......... .......... 86% 120M 0s 2020-04-28T12:42:07.423 INFO:teuthology.orchestra.run.smithi197.stderr: 80050K .......... .......... .......... .......... .......... 86% 113M 0s 2020-04-28T12:42:07.423 INFO:teuthology.orchestra.run.smithi197.stderr: 80100K .......... .......... .......... .......... .......... 86% 108M 0s 2020-04-28T12:42:07.423 INFO:teuthology.orchestra.run.smithi197.stderr: 80150K .......... .......... .......... .......... .......... 86% 117M 0s 2020-04-28T12:42:07.423 INFO:teuthology.orchestra.run.smithi197.stderr: 80200K .......... .......... .......... .......... .......... 86% 119M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80250K .......... .......... .......... .......... .......... 86% 117M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80300K .......... .......... .......... .......... .......... 86% 110M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80350K .......... .......... .......... .......... .......... 86% 96.8M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80400K .......... .......... .......... .......... .......... 86% 111M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80450K .......... .......... .......... .......... .......... 86% 120M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80500K .......... .......... .......... .......... .......... 86% 122M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80550K .......... .......... .......... .......... .......... 86% 92.3M 0s 2020-04-28T12:42:07.424 INFO:teuthology.orchestra.run.smithi197.stderr: 80600K .......... .......... .......... .......... .......... 86% 127M 0s 2020-04-28T12:42:07.425 INFO:teuthology.orchestra.run.smithi197.stderr: 80650K .......... .......... .......... .......... .......... 86% 125M 0s 2020-04-28T12:42:07.425 INFO:teuthology.orchestra.run.smithi197.stderr: 80700K .......... .......... .......... .......... .......... 86% 127M 0s 2020-04-28T12:42:07.425 INFO:teuthology.orchestra.run.smithi197.stderr: 80750K .......... .......... .......... .......... .......... 86% 77.7M 0s 2020-04-28T12:42:07.425 INFO:teuthology.orchestra.run.smithi197.stderr: 80800K .......... .......... .......... .......... .......... 87% 126M 0s 2020-04-28T12:42:07.425 INFO:teuthology.orchestra.run.smithi197.stderr: 80850K .......... .......... .......... .......... .......... 87% 93.9M 0s 2020-04-28T12:42:07.425 INFO:teuthology.orchestra.run.smithi197.stderr: 80900K .......... .......... .......... .......... .......... 87% 128M 0s 2020-04-28T12:42:07.425 INFO:teuthology.orchestra.run.smithi197.stderr: 80950K .......... .......... .......... .......... .......... 87% 121M 0s 2020-04-28T12:42:07.426 INFO:teuthology.orchestra.run.smithi197.stderr: 81000K .......... .......... .......... .......... .......... 87% 116M 0s 2020-04-28T12:42:07.426 INFO:teuthology.orchestra.run.smithi197.stderr: 81050K .......... .......... .......... .......... .......... 87% 102M 0s 2020-04-28T12:42:07.426 INFO:teuthology.orchestra.run.smithi197.stderr: 81100K .......... .......... .......... .......... .......... 87% 124M 0s 2020-04-28T12:42:07.426 INFO:teuthology.orchestra.run.smithi197.stderr: 81150K .......... .......... .......... .......... .......... 87% 98.9M 0s 2020-04-28T12:42:07.426 INFO:teuthology.orchestra.run.smithi197.stderr: 81200K .......... .......... .......... .......... .......... 87% 94.4M 0s 2020-04-28T12:42:07.426 INFO:teuthology.orchestra.run.smithi197.stderr: 81250K .......... .......... .......... .......... .......... 87% 127M 0s 2020-04-28T12:42:07.426 INFO:teuthology.orchestra.run.smithi197.stderr: 81300K .......... .......... .......... .......... .......... 87% 126M 0s 2020-04-28T12:42:07.427 INFO:teuthology.orchestra.run.smithi197.stderr: 81350K .......... .......... .......... .......... .......... 87% 121M 0s 2020-04-28T12:42:07.427 INFO:teuthology.orchestra.run.smithi197.stderr: 81400K .......... .......... .......... .......... .......... 87% 94.9M 0s 2020-04-28T12:42:07.427 INFO:teuthology.orchestra.run.smithi197.stderr: 81450K .......... .......... .......... .......... .......... 87% 138M 0s 2020-04-28T12:42:07.427 INFO:teuthology.orchestra.run.smithi197.stderr: 81500K .......... .......... .......... .......... .......... 87% 129M 0s 2020-04-28T12:42:07.427 INFO:teuthology.orchestra.run.smithi197.stderr: 81550K .......... .......... .......... .......... .......... 87% 86.8M 0s 2020-04-28T12:42:07.427 INFO:teuthology.orchestra.run.smithi197.stderr: 81600K .......... .......... .......... .......... .......... 87% 115M 0s 2020-04-28T12:42:07.427 INFO:teuthology.orchestra.run.smithi197.stderr: 81650K .......... .......... .......... .......... .......... 87% 108M 0s 2020-04-28T12:42:07.428 INFO:teuthology.orchestra.run.smithi197.stderr: 81700K .......... .......... .......... .......... .......... 87% 129M 0s 2020-04-28T12:42:07.428 INFO:teuthology.orchestra.run.smithi197.stderr: 81750K .......... .......... .......... .......... .......... 88% 108M 0s 2020-04-28T12:42:07.428 INFO:teuthology.orchestra.run.smithi197.stderr: 81800K .......... .......... .......... .......... .......... 88% 123M 0s 2020-04-28T12:42:07.428 INFO:teuthology.orchestra.run.smithi197.stderr: 81850K .......... .......... .......... .......... .......... 88% 109M 0s 2020-04-28T12:42:07.428 INFO:teuthology.orchestra.run.smithi197.stderr: 81900K .......... .......... .......... .......... .......... 88% 112M 0s 2020-04-28T12:42:07.428 INFO:teuthology.orchestra.run.smithi197.stderr: 81950K .......... .......... .......... .......... .......... 88% 90.2M 0s 2020-04-28T12:42:07.428 INFO:teuthology.orchestra.run.smithi197.stderr: 82000K .......... .......... .......... .......... .......... 88% 112M 0s 2020-04-28T12:42:07.429 INFO:teuthology.orchestra.run.smithi197.stderr: 82050K .......... .......... .......... .......... .......... 88% 120M 0s 2020-04-28T12:42:07.429 INFO:teuthology.orchestra.run.smithi197.stderr: 82100K .......... .......... .......... .......... .......... 88% 117M 0s 2020-04-28T12:42:07.429 INFO:teuthology.orchestra.run.smithi197.stderr: 82150K .......... .......... .......... .......... .......... 88% 113M 0s 2020-04-28T12:42:07.429 INFO:teuthology.orchestra.run.smithi197.stderr: 82200K .......... .......... .......... .......... .......... 88% 117M 0s 2020-04-28T12:42:07.429 INFO:teuthology.orchestra.run.smithi197.stderr: 82250K .......... .......... .......... .......... .......... 88% 114M 0s 2020-04-28T12:42:07.429 INFO:teuthology.orchestra.run.smithi197.stderr: 82300K .......... .......... .......... .......... .......... 88% 117M 0s 2020-04-28T12:42:07.429 INFO:teuthology.orchestra.run.smithi197.stderr: 82350K .......... .......... .......... .......... .......... 88% 91.5M 0s 2020-04-28T12:42:07.430 INFO:teuthology.orchestra.run.smithi197.stderr: 82400K .......... .......... .......... .......... .......... 88% 107M 0s 2020-04-28T12:42:07.430 INFO:teuthology.orchestra.run.smithi197.stderr: 82450K .......... .......... .......... .......... .......... 88% 112M 0s 2020-04-28T12:42:07.430 INFO:teuthology.orchestra.run.smithi197.stderr: 82500K .......... .......... .......... .......... .......... 88% 127M 0s 2020-04-28T12:42:07.430 INFO:teuthology.orchestra.run.smithi197.stderr: 82550K .......... .......... .......... .......... .......... 88% 109M 0s 2020-04-28T12:42:07.430 INFO:teuthology.orchestra.run.smithi197.stderr: 82600K .......... .......... .......... .......... .......... 88% 120M 0s 2020-04-28T12:42:07.430 INFO:teuthology.orchestra.run.smithi197.stderr: 82650K .......... .......... .......... .......... .......... 89% 115M 0s 2020-04-28T12:42:07.430 INFO:teuthology.orchestra.run.smithi197.stderr: 82700K .......... .......... .......... .......... .......... 89% 117M 0s 2020-04-28T12:42:07.431 INFO:teuthology.orchestra.run.smithi197.stderr: 82750K .......... .......... .......... .......... .......... 89% 91.1M 0s 2020-04-28T12:42:07.431 INFO:teuthology.orchestra.run.smithi197.stderr: 82800K .......... .......... .......... .......... .......... 89% 115M 0s 2020-04-28T12:42:07.431 INFO:teuthology.orchestra.run.smithi197.stderr: 82850K .......... .......... .......... .......... .......... 89% 117M 0s 2020-04-28T12:42:07.431 INFO:teuthology.orchestra.run.smithi197.stderr: 82900K .......... .......... .......... .......... .......... 89% 121M 0s 2020-04-28T12:42:07.431 INFO:teuthology.orchestra.run.smithi197.stderr: 82950K .......... .......... .......... .......... .......... 89% 112M 0s 2020-04-28T12:42:07.431 INFO:teuthology.orchestra.run.smithi197.stderr: 83000K .......... .......... .......... .......... .......... 89% 112M 0s 2020-04-28T12:42:07.431 INFO:teuthology.orchestra.run.smithi197.stderr: 83050K .......... .......... .......... .......... .......... 89% 106M 0s 2020-04-28T12:42:07.432 INFO:teuthology.orchestra.run.smithi197.stderr: 83100K .......... .......... .......... .......... .......... 89% 102M 0s 2020-04-28T12:42:07.432 INFO:teuthology.orchestra.run.smithi197.stderr: 83150K .......... .......... .......... .......... .......... 89% 102M 0s 2020-04-28T12:42:07.432 INFO:teuthology.orchestra.run.smithi197.stderr: 83200K .......... .......... .......... .......... .......... 89% 116M 0s 2020-04-28T12:42:07.432 INFO:teuthology.orchestra.run.smithi197.stderr: 83250K .......... .......... .......... .......... .......... 89% 111M 0s 2020-04-28T12:42:07.432 INFO:teuthology.orchestra.run.smithi197.stderr: 83300K .......... .......... .......... .......... .......... 89% 117M 0s 2020-04-28T12:42:07.432 INFO:teuthology.orchestra.run.smithi197.stderr: 83350K .......... .......... .......... .......... .......... 89% 112M 0s 2020-04-28T12:42:07.432 INFO:teuthology.orchestra.run.smithi197.stderr: 83400K .......... .......... .......... .......... .......... 89% 119M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83450K .......... .......... .......... .......... .......... 89% 106M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83500K .......... .......... .......... .......... .......... 89% 115M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83550K .......... .......... .......... .......... .......... 89% 87.9M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83600K .......... .......... .......... .......... .......... 90% 116M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83650K .......... .......... .......... .......... .......... 90% 119M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83700K .......... .......... .......... .......... .......... 90% 104M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83750K .......... .......... .......... .......... .......... 90% 106M 0s 2020-04-28T12:42:07.433 INFO:teuthology.orchestra.run.smithi197.stderr: 83800K .......... .......... .......... .......... .......... 90% 116M 0s 2020-04-28T12:42:07.434 INFO:teuthology.orchestra.run.smithi197.stderr: 83850K .......... .......... .......... .......... .......... 90% 118M 0s 2020-04-28T12:42:07.434 INFO:teuthology.orchestra.run.smithi197.stderr: 83900K .......... .......... .......... .......... .......... 90% 114M 0s 2020-04-28T12:42:07.434 INFO:teuthology.orchestra.run.smithi197.stderr: 83950K .......... .......... .......... .......... .......... 90% 89.1M 0s 2020-04-28T12:42:07.434 INFO:teuthology.orchestra.run.smithi197.stderr: 84000K .......... .......... .......... .......... .......... 90% 112M 0s 2020-04-28T12:42:07.434 INFO:teuthology.orchestra.run.smithi197.stderr: 84050K .......... .......... .......... .......... .......... 90% 114M 0s 2020-04-28T12:42:07.434 INFO:teuthology.orchestra.run.smithi197.stderr: 84100K .......... .......... .......... .......... .......... 90% 121M 0s 2020-04-28T12:42:07.435 INFO:teuthology.orchestra.run.smithi197.stderr: 84150K .......... .......... .......... .......... .......... 90% 111M 0s 2020-04-28T12:42:07.435 INFO:teuthology.orchestra.run.smithi197.stderr: 84200K .......... .......... .......... .......... .......... 90% 117M 0s 2020-04-28T12:42:07.435 INFO:teuthology.orchestra.run.smithi197.stderr: 84250K .......... .......... .......... .......... .......... 90% 116M 0s 2020-04-28T12:42:07.435 INFO:teuthology.orchestra.run.smithi197.stderr: 84300K .......... .......... .......... .......... .......... 90% 119M 0s 2020-04-28T12:42:07.435 INFO:teuthology.orchestra.run.smithi197.stderr: 84350K .......... .......... .......... .......... .......... 90% 86.3M 0s 2020-04-28T12:42:07.435 INFO:teuthology.orchestra.run.smithi197.stderr: 84400K .......... .......... .......... .......... .......... 90% 121M 0s 2020-04-28T12:42:07.435 INFO:teuthology.orchestra.run.smithi197.stderr: 84450K .......... .......... .......... .......... .......... 90% 109M 0s 2020-04-28T12:42:07.436 INFO:teuthology.orchestra.run.smithi197.stderr: 84500K .......... .......... .......... .......... .......... 91% 117M 0s 2020-04-28T12:42:07.436 INFO:teuthology.orchestra.run.smithi197.stderr: 84550K .......... .......... .......... .......... .......... 91% 111M 0s 2020-04-28T12:42:07.436 INFO:teuthology.orchestra.run.smithi197.stderr: 84600K .......... .......... .......... .......... .......... 91% 117M 0s 2020-04-28T12:42:07.436 INFO:teuthology.orchestra.run.smithi197.stderr: 84650K .......... .......... .......... .......... .......... 91% 110M 0s 2020-04-28T12:42:07.436 INFO:teuthology.orchestra.run.smithi197.stderr: 84700K .......... .......... .......... .......... .......... 91% 117M 0s 2020-04-28T12:42:07.436 INFO:teuthology.orchestra.run.smithi197.stderr: 84750K .......... .......... .......... .......... .......... 91% 93.3M 0s 2020-04-28T12:42:07.436 INFO:teuthology.orchestra.run.smithi197.stderr: 84800K .......... .......... .......... .......... .......... 91% 116M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 84850K .......... .......... .......... .......... .......... 91% 113M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 84900K .......... .......... .......... .......... .......... 91% 120M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 84950K .......... .......... .......... .......... .......... 91% 108M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 85000K .......... .......... .......... .......... .......... 91% 114M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 85050K .......... .......... .......... .......... .......... 91% 108M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 85100K .......... .......... .......... .......... .......... 91% 124M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 85150K .......... .......... .......... .......... .......... 91% 90.0M 0s 2020-04-28T12:42:07.437 INFO:teuthology.orchestra.run.smithi197.stderr: 85200K .......... .......... .......... .......... .......... 91% 115M 0s 2020-04-28T12:42:07.438 INFO:teuthology.orchestra.run.smithi197.stderr: 85250K .......... .......... .......... .......... .......... 91% 107M 0s 2020-04-28T12:42:07.438 INFO:teuthology.orchestra.run.smithi197.stderr: 85300K .......... .......... .......... .......... .......... 91% 115M 0s 2020-04-28T12:42:07.438 INFO:teuthology.orchestra.run.smithi197.stderr: 85350K .......... .......... .......... .......... .......... 91% 119M 0s 2020-04-28T12:42:07.438 INFO:teuthology.orchestra.run.smithi197.stderr: 85400K .......... .......... .......... .......... .......... 91% 114M 0s 2020-04-28T12:42:07.438 INFO:teuthology.orchestra.run.smithi197.stderr: 85450K .......... .......... .......... .......... .......... 92% 113M 0s 2020-04-28T12:42:07.438 INFO:teuthology.orchestra.run.smithi197.stderr: 85500K .......... .......... .......... .......... .......... 92% 119M 0s 2020-04-28T12:42:07.439 INFO:teuthology.orchestra.run.smithi197.stderr: 85550K .......... .......... .......... .......... .......... 92% 90.4M 0s 2020-04-28T12:42:07.439 INFO:teuthology.orchestra.run.smithi197.stderr: 85600K .......... .......... .......... .......... .......... 92% 117M 0s 2020-04-28T12:42:07.439 INFO:teuthology.orchestra.run.smithi197.stderr: 85650K .......... .......... .......... .......... .......... 92% 116M 0s 2020-04-28T12:42:07.439 INFO:teuthology.orchestra.run.smithi197.stderr: 85700K .......... .......... .......... .......... .......... 92% 108M 0s 2020-04-28T12:42:07.439 INFO:teuthology.orchestra.run.smithi197.stderr: 85750K .......... .......... .......... .......... .......... 92% 119M 0s 2020-04-28T12:42:07.439 INFO:teuthology.orchestra.run.smithi197.stderr: 85800K .......... .......... .......... .......... .......... 92% 116M 0s 2020-04-28T12:42:07.439 INFO:teuthology.orchestra.run.smithi197.stderr: 85850K .......... .......... .......... .......... .......... 92% 118M 0s 2020-04-28T12:42:07.440 INFO:teuthology.orchestra.run.smithi197.stderr: 85900K .......... .......... .......... .......... .......... 92% 105M 0s 2020-04-28T12:42:07.440 INFO:teuthology.orchestra.run.smithi197.stderr: 85950K .......... .......... .......... .......... .......... 92% 91.9M 0s 2020-04-28T12:42:07.440 INFO:teuthology.orchestra.run.smithi197.stderr: 86000K .......... .......... .......... .......... .......... 92% 104M 0s 2020-04-28T12:42:07.440 INFO:teuthology.orchestra.run.smithi197.stderr: 86050K .......... .......... .......... .......... .......... 92% 125M 0s 2020-04-28T12:42:07.440 INFO:teuthology.orchestra.run.smithi197.stderr: 86100K .......... .......... .......... .......... .......... 92% 94.5M 0s 2020-04-28T12:42:07.440 INFO:teuthology.orchestra.run.smithi197.stderr: 86150K .......... .......... .......... .......... .......... 92% 122M 0s 2020-04-28T12:42:07.440 INFO:teuthology.orchestra.run.smithi197.stderr: 86200K .......... .......... .......... .......... .......... 92% 126M 0s 2020-04-28T12:42:07.441 INFO:teuthology.orchestra.run.smithi197.stderr: 86250K .......... .......... .......... .......... .......... 92% 94.9M 0s 2020-04-28T12:42:07.441 INFO:teuthology.orchestra.run.smithi197.stderr: 86300K .......... .......... .......... .......... .......... 92% 146M 0s 2020-04-28T12:42:07.441 INFO:teuthology.orchestra.run.smithi197.stderr: 86350K .......... .......... .......... .......... .......... 93% 92.2M 0s 2020-04-28T12:42:07.441 INFO:teuthology.orchestra.run.smithi197.stderr: 86400K .......... .......... .......... .......... .......... 93% 115M 0s 2020-04-28T12:42:07.441 INFO:teuthology.orchestra.run.smithi197.stderr: 86450K .......... .......... .......... .......... .......... 93% 96.7M 0s 2020-04-28T12:42:07.441 INFO:teuthology.orchestra.run.smithi197.stderr: 86500K .......... .......... .......... .......... .......... 93% 126M 0s 2020-04-28T12:42:07.441 INFO:teuthology.orchestra.run.smithi197.stderr: 86550K .......... .......... .......... .......... .......... 93% 91.6M 0s 2020-04-28T12:42:07.442 INFO:teuthology.orchestra.run.smithi197.stderr: 86600K .......... .......... .......... .......... .......... 93% 126M 0s 2020-04-28T12:42:07.442 INFO:teuthology.orchestra.run.smithi197.stderr: 86650K .......... .......... .......... .......... .......... 93% 127M 0s 2020-04-28T12:42:07.442 INFO:teuthology.orchestra.run.smithi197.stderr: 86700K .......... .......... .......... .......... .......... 93% 123M 0s 2020-04-28T12:42:07.442 INFO:teuthology.orchestra.run.smithi197.stderr: 86750K .......... .......... .......... .......... .......... 93% 90.8M 0s 2020-04-28T12:42:07.442 INFO:teuthology.orchestra.run.smithi197.stderr: 86800K .......... .......... .......... .......... .......... 93% 108M 0s 2020-04-28T12:42:07.442 INFO:teuthology.orchestra.run.smithi197.stderr: 86850K .......... .......... .......... .......... .......... 93% 91.5M 0s 2020-04-28T12:42:07.442 INFO:teuthology.orchestra.run.smithi197.stderr: 86900K .......... .......... .......... .......... .......... 93% 127M 0s 2020-04-28T12:42:07.443 INFO:teuthology.orchestra.run.smithi197.stderr: 86950K .......... .......... .......... .......... .......... 93% 121M 0s 2020-04-28T12:42:07.443 INFO:teuthology.orchestra.run.smithi197.stderr: 87000K .......... .......... .......... .......... .......... 93% 94.6M 0s 2020-04-28T12:42:07.443 INFO:teuthology.orchestra.run.smithi197.stderr: 87050K .......... .......... .......... .......... .......... 93% 126M 0s 2020-04-28T12:42:07.443 INFO:teuthology.orchestra.run.smithi197.stderr: 87100K .......... .......... .......... .......... .......... 93% 94.3M 0s 2020-04-28T12:42:07.443 INFO:teuthology.orchestra.run.smithi197.stderr: 87150K .......... .......... .......... .......... .......... 93% 97.8M 0s 2020-04-28T12:42:07.443 INFO:teuthology.orchestra.run.smithi197.stderr: 87200K .......... .......... .......... .......... .......... 93% 121M 0s 2020-04-28T12:42:07.443 INFO:teuthology.orchestra.run.smithi197.stderr: 87250K .......... .......... .......... .......... .......... 93% 114M 0s 2020-04-28T12:42:07.444 INFO:teuthology.orchestra.run.smithi197.stderr: 87300K .......... .......... .......... .......... .......... 94% 107M 0s 2020-04-28T12:42:07.444 INFO:teuthology.orchestra.run.smithi197.stderr: 87350K .......... .......... .......... .......... .......... 94% 112M 0s 2020-04-28T12:42:07.444 INFO:teuthology.orchestra.run.smithi197.stderr: 87400K .......... .......... .......... .......... .......... 94% 119M 0s 2020-04-28T12:42:07.444 INFO:teuthology.orchestra.run.smithi197.stderr: 87450K .......... .......... .......... .......... .......... 94% 118M 0s 2020-04-28T12:42:07.444 INFO:teuthology.orchestra.run.smithi197.stderr: 87500K .......... .......... .......... .......... .......... 94% 113M 0s 2020-04-28T12:42:07.444 INFO:teuthology.orchestra.run.smithi197.stderr: 87550K .......... .......... .......... .......... .......... 94% 91.0M 0s 2020-04-28T12:42:07.444 INFO:teuthology.orchestra.run.smithi197.stderr: 87600K .......... .......... .......... .......... .......... 94% 116M 0s 2020-04-28T12:42:07.445 INFO:teuthology.orchestra.run.smithi197.stderr: 87650K .......... .......... .......... .......... .......... 94% 93.0M 0s 2020-04-28T12:42:07.445 INFO:teuthology.orchestra.run.smithi197.stderr: 87700K .......... .......... .......... .......... .......... 94% 102M 0s 2020-04-28T12:42:07.445 INFO:teuthology.orchestra.run.smithi197.stderr: 87750K .......... .......... .......... .......... .......... 94% 94.4M 0s 2020-04-28T12:42:07.445 INFO:teuthology.orchestra.run.smithi197.stderr: 87800K .......... .......... .......... .......... .......... 94% 198M 0s 2020-04-28T12:42:07.445 INFO:teuthology.orchestra.run.smithi197.stderr: 87850K .......... .......... .......... .......... .......... 94% 143M 0s 2020-04-28T12:42:07.445 INFO:teuthology.orchestra.run.smithi197.stderr: 87900K .......... .......... .......... .......... .......... 94% 112M 0s 2020-04-28T12:42:07.445 INFO:teuthology.orchestra.run.smithi197.stderr: 87950K .......... .......... .......... .......... .......... 94% 88.5M 0s 2020-04-28T12:42:07.446 INFO:teuthology.orchestra.run.smithi197.stderr: 88000K .......... .......... .......... .......... .......... 94% 109M 0s 2020-04-28T12:42:07.446 INFO:teuthology.orchestra.run.smithi197.stderr: 88050K .......... .......... .......... .......... .......... 94% 122M 0s 2020-04-28T12:42:07.446 INFO:teuthology.orchestra.run.smithi197.stderr: 88100K .......... .......... .......... .......... .......... 94% 97.5M 0s 2020-04-28T12:42:07.446 INFO:teuthology.orchestra.run.smithi197.stderr: 88150K .......... .......... .......... .......... .......... 94% 109M 0s 2020-04-28T12:42:07.446 INFO:teuthology.orchestra.run.smithi197.stderr: 88200K .......... .......... .......... .......... .......... 94% 124M 0s 2020-04-28T12:42:07.446 INFO:teuthology.orchestra.run.smithi197.stderr: 88250K .......... .......... .......... .......... .......... 95% 117M 0s 2020-04-28T12:42:07.446 INFO:teuthology.orchestra.run.smithi197.stderr: 88300K .......... .......... .......... .......... .......... 95% 116M 0s 2020-04-28T12:42:07.447 INFO:teuthology.orchestra.run.smithi197.stderr: 88350K .......... .......... .......... .......... .......... 95% 88.6M 0s 2020-04-28T12:42:07.447 INFO:teuthology.orchestra.run.smithi197.stderr: 88400K .......... .......... .......... .......... .......... 95% 116M 0s 2020-04-28T12:42:07.447 INFO:teuthology.orchestra.run.smithi197.stderr: 88450K .......... .......... .......... .......... .......... 95% 117M 0s 2020-04-28T12:42:07.447 INFO:teuthology.orchestra.run.smithi197.stderr: 88500K .......... .......... .......... .......... .......... 95% 121M 0s 2020-04-28T12:42:07.447 INFO:teuthology.orchestra.run.smithi197.stderr: 88550K .......... .......... .......... .......... .......... 95% 111M 0s 2020-04-28T12:42:07.447 INFO:teuthology.orchestra.run.smithi197.stderr: 88600K .......... .......... .......... .......... .......... 95% 116M 0s 2020-04-28T12:42:07.447 INFO:teuthology.orchestra.run.smithi197.stderr: 88650K .......... .......... .......... .......... .......... 95% 116M 0s 2020-04-28T12:42:07.448 INFO:teuthology.orchestra.run.smithi197.stderr: 88700K .......... .......... .......... .......... .......... 95% 117M 0s 2020-04-28T12:42:07.448 INFO:teuthology.orchestra.run.smithi197.stderr: 88750K .......... .......... .......... .......... .......... 95% 91.6M 0s 2020-04-28T12:42:07.448 INFO:teuthology.orchestra.run.smithi197.stderr: 88800K .......... .......... .......... .......... .......... 95% 112M 0s 2020-04-28T12:42:07.448 INFO:teuthology.orchestra.run.smithi197.stderr: 88850K .......... .......... .......... .......... .......... 95% 118M 0s 2020-04-28T12:42:07.448 INFO:teuthology.orchestra.run.smithi197.stderr: 88900K .......... .......... .......... .......... .......... 95% 118M 0s 2020-04-28T12:42:07.448 INFO:teuthology.orchestra.run.smithi197.stderr: 88950K .......... .......... .......... .......... .......... 95% 110M 0s 2020-04-28T12:42:07.448 INFO:teuthology.orchestra.run.smithi197.stderr: 89000K .......... .......... .......... .......... .......... 95% 114M 0s 2020-04-28T12:42:07.449 INFO:teuthology.orchestra.run.smithi197.stderr: 89050K .......... .......... .......... .......... .......... 95% 119M 0s 2020-04-28T12:42:07.449 INFO:teuthology.orchestra.run.smithi197.stderr: 89100K .......... .......... .......... .......... .......... 95% 113M 0s 2020-04-28T12:42:07.449 INFO:teuthology.orchestra.run.smithi197.stderr: 89150K .......... .......... .......... .......... .......... 96% 87.4M 0s 2020-04-28T12:42:07.449 INFO:teuthology.orchestra.run.smithi197.stderr: 89200K .......... .......... .......... .......... .......... 96% 109M 0s 2020-04-28T12:42:07.449 INFO:teuthology.orchestra.run.smithi197.stderr: 89250K .......... .......... .......... .......... .......... 96% 119M 0s 2020-04-28T12:42:07.449 INFO:teuthology.orchestra.run.smithi197.stderr: 89300K .......... .......... .......... .......... .......... 96% 101M 0s 2020-04-28T12:42:07.449 INFO:teuthology.orchestra.run.smithi197.stderr: 89350K .......... .......... .......... .......... .......... 96% 134M 0s 2020-04-28T12:42:07.450 INFO:teuthology.orchestra.run.smithi197.stderr: 89400K .......... .......... .......... .......... .......... 96% 116M 0s 2020-04-28T12:42:07.450 INFO:teuthology.orchestra.run.smithi197.stderr: 89450K .......... .......... .......... .......... .......... 96% 116M 0s 2020-04-28T12:42:07.450 INFO:teuthology.orchestra.run.smithi197.stderr: 89500K .......... .......... .......... .......... .......... 96% 117M 0s 2020-04-28T12:42:07.450 INFO:teuthology.orchestra.run.smithi197.stderr: 89550K .......... .......... .......... .......... .......... 96% 89.5M 0s 2020-04-28T12:42:07.450 INFO:teuthology.orchestra.run.smithi197.stderr: 89600K .......... .......... .......... .......... .......... 96% 114M 0s 2020-04-28T12:42:07.450 INFO:teuthology.orchestra.run.smithi197.stderr: 89650K .......... .......... .......... .......... .......... 96% 119M 0s 2020-04-28T12:42:07.450 INFO:teuthology.orchestra.run.smithi197.stderr: 89700K .......... .......... .......... .......... .......... 96% 117M 0s 2020-04-28T12:42:07.451 INFO:teuthology.orchestra.run.smithi197.stderr: 89750K .......... .......... .......... .......... .......... 96% 112M 0s 2020-04-28T12:42:07.451 INFO:teuthology.orchestra.run.smithi197.stderr: 89800K .......... .......... .......... .......... .......... 96% 115M 0s 2020-04-28T12:42:07.451 INFO:teuthology.orchestra.run.smithi197.stderr: 89850K .......... .......... .......... .......... .......... 96% 108M 0s 2020-04-28T12:42:07.451 INFO:teuthology.orchestra.run.smithi197.stderr: 89900K .......... .......... .......... .......... .......... 96% 115M 0s 2020-04-28T12:42:07.451 INFO:teuthology.orchestra.run.smithi197.stderr: 89950K .......... .......... .......... .......... .......... 96% 92.7M 0s 2020-04-28T12:42:07.451 INFO:teuthology.orchestra.run.smithi197.stderr: 90000K .......... .......... .......... .......... .......... 96% 112M 0s 2020-04-28T12:42:07.451 INFO:teuthology.orchestra.run.smithi197.stderr: 90050K .......... .......... .......... .......... .......... 96% 123M 0s 2020-04-28T12:42:07.452 INFO:teuthology.orchestra.run.smithi197.stderr: 90100K .......... .......... .......... .......... .......... 97% 112M 0s 2020-04-28T12:42:07.452 INFO:teuthology.orchestra.run.smithi197.stderr: 90150K .......... .......... .......... .......... .......... 97% 115M 0s 2020-04-28T12:42:07.452 INFO:teuthology.orchestra.run.smithi197.stderr: 90200K .......... .......... .......... .......... .......... 97% 115M 0s 2020-04-28T12:42:07.452 INFO:teuthology.orchestra.run.smithi197.stderr: 90250K .......... .......... .......... .......... .......... 97% 115M 0s 2020-04-28T12:42:07.452 INFO:teuthology.orchestra.run.smithi197.stderr: 90300K .......... .......... .......... .......... .......... 97% 109M 0s 2020-04-28T12:42:07.453 INFO:teuthology.orchestra.run.smithi197.stderr: 90350K .......... .......... .......... .......... .......... 97% 93.4M 0s 2020-04-28T12:42:07.453 INFO:teuthology.orchestra.run.smithi197.stderr: 90400K .......... .......... .......... .......... .......... 97% 117M 0s 2020-04-28T12:42:07.453 INFO:teuthology.orchestra.run.smithi197.stderr: 90450K .......... .......... .......... .......... .......... 97% 118M 0s 2020-04-28T12:42:07.453 INFO:teuthology.orchestra.run.smithi197.stderr: 90500K .......... .......... .......... .......... .......... 97% 114M 0s 2020-04-28T12:42:07.453 INFO:teuthology.orchestra.run.smithi197.stderr: 90550K .......... .......... .......... .......... .......... 97% 116M 0s 2020-04-28T12:42:07.453 INFO:teuthology.orchestra.run.smithi197.stderr: 90600K .......... .......... .......... .......... .......... 97% 116M 0s 2020-04-28T12:42:07.453 INFO:teuthology.orchestra.run.smithi197.stderr: 90650K .......... .......... .......... .......... .......... 97% 120M 0s 2020-04-28T12:42:07.454 INFO:teuthology.orchestra.run.smithi197.stderr: 90700K .......... .......... .......... .......... .......... 97% 114M 0s 2020-04-28T12:42:07.454 INFO:teuthology.orchestra.run.smithi197.stderr: 90750K .......... .......... .......... .......... .......... 97% 86.5M 0s 2020-04-28T12:42:07.454 INFO:teuthology.orchestra.run.smithi197.stderr: 90800K .......... .......... .......... .......... .......... 97% 122M 0s 2020-04-28T12:42:07.454 INFO:teuthology.orchestra.run.smithi197.stderr: 90850K .......... .......... .......... .......... .......... 97% 110M 0s 2020-04-28T12:42:07.454 INFO:teuthology.orchestra.run.smithi197.stderr: 90900K .......... .......... .......... .......... .......... 97% 94.1M 0s 2020-04-28T12:42:07.454 INFO:teuthology.orchestra.run.smithi197.stderr: 90950K .......... .......... .......... .......... .......... 97% 145M 0s 2020-04-28T12:42:07.454 INFO:teuthology.orchestra.run.smithi197.stderr: 91000K .......... .......... .......... .......... .......... 98% 117M 0s 2020-04-28T12:42:07.455 INFO:teuthology.orchestra.run.smithi197.stderr: 91050K .......... .......... .......... .......... .......... 98% 108M 0s 2020-04-28T12:42:07.455 INFO:teuthology.orchestra.run.smithi197.stderr: 91100K .......... .......... .......... .......... .......... 98% 122M 0s 2020-04-28T12:42:07.455 INFO:teuthology.orchestra.run.smithi197.stderr: 91150K .......... .......... .......... .......... .......... 98% 93.6M 0s 2020-04-28T12:42:07.455 INFO:teuthology.orchestra.run.smithi197.stderr: 91200K .......... .......... .......... .......... .......... 98% 110M 0s 2020-04-28T12:42:07.455 INFO:teuthology.orchestra.run.smithi197.stderr: 91250K .......... .......... .......... .......... .......... 98% 110M 0s 2020-04-28T12:42:07.455 INFO:teuthology.orchestra.run.smithi197.stderr: 91300K .......... .......... .......... .......... .......... 98% 117M 0s 2020-04-28T12:42:07.455 INFO:teuthology.orchestra.run.smithi197.stderr: 91350K .......... .......... .......... .......... .......... 98% 118M 0s 2020-04-28T12:42:07.456 INFO:teuthology.orchestra.run.smithi197.stderr: 91400K .......... .......... .......... .......... .......... 98% 123M 0s 2020-04-28T12:42:07.456 INFO:teuthology.orchestra.run.smithi197.stderr: 91450K .......... .......... .......... .......... .......... 98% 120M 0s 2020-04-28T12:42:07.456 INFO:teuthology.orchestra.run.smithi197.stderr: 91500K .......... .......... .......... .......... .......... 98% 107M 0s 2020-04-28T12:42:07.456 INFO:teuthology.orchestra.run.smithi197.stderr: 91550K .......... .......... .......... .......... .......... 98% 93.2M 0s 2020-04-28T12:42:07.456 INFO:teuthology.orchestra.run.smithi197.stderr: 91600K .......... .......... .......... .......... .......... 98% 108M 0s 2020-04-28T12:42:07.456 INFO:teuthology.orchestra.run.smithi197.stderr: 91650K .......... .......... .......... .......... .......... 98% 122M 0s 2020-04-28T12:42:07.456 INFO:teuthology.orchestra.run.smithi197.stderr: 91700K .......... .......... .......... .......... .......... 98% 113M 0s 2020-04-28T12:42:07.457 INFO:teuthology.orchestra.run.smithi197.stderr: 91750K .......... .......... .......... .......... .......... 98% 112M 0s 2020-04-28T12:42:07.457 INFO:teuthology.orchestra.run.smithi197.stderr: 91800K .......... .......... .......... .......... .......... 98% 113M 0s 2020-04-28T12:42:07.457 INFO:teuthology.orchestra.run.smithi197.stderr: 91850K .......... .......... .......... .......... .......... 98% 124M 0s 2020-04-28T12:42:07.457 INFO:teuthology.orchestra.run.smithi197.stderr: 91900K .......... .......... .......... .......... .......... 98% 119M 0s 2020-04-28T12:42:07.457 INFO:teuthology.orchestra.run.smithi197.stderr: 91950K .......... .......... .......... .......... .......... 99% 90.4M 0s 2020-04-28T12:42:07.457 INFO:teuthology.orchestra.run.smithi197.stderr: 92000K .......... .......... .......... .......... .......... 99% 116M 0s 2020-04-28T12:42:07.457 INFO:teuthology.orchestra.run.smithi197.stderr: 92050K .......... .......... .......... .......... .......... 99% 115M 0s 2020-04-28T12:42:07.458 INFO:teuthology.orchestra.run.smithi197.stderr: 92100K .......... .......... .......... .......... .......... 99% 118M 0s 2020-04-28T12:42:07.458 INFO:teuthology.orchestra.run.smithi197.stderr: 92150K .......... .......... .......... .......... .......... 99% 113M 0s 2020-04-28T12:42:07.458 INFO:teuthology.orchestra.run.smithi197.stderr: 92200K .......... .......... .......... .......... .......... 99% 110M 0s 2020-04-28T12:42:07.458 INFO:teuthology.orchestra.run.smithi197.stderr: 92250K .......... .......... .......... .......... .......... 99% 126M 0s 2020-04-28T12:42:07.458 INFO:teuthology.orchestra.run.smithi197.stderr: 92300K .......... .......... .......... .......... .......... 99% 117M 0s 2020-04-28T12:42:07.458 INFO:teuthology.orchestra.run.smithi197.stderr: 92350K .......... .......... .......... .......... .......... 99% 89.0M 0s 2020-04-28T12:42:07.458 INFO:teuthology.orchestra.run.smithi197.stderr: 92400K .......... .......... .......... .......... .......... 99% 117M 0s 2020-04-28T12:42:07.459 INFO:teuthology.orchestra.run.smithi197.stderr: 92450K .......... .......... .......... .......... .......... 99% 113M 0s 2020-04-28T12:42:07.459 INFO:teuthology.orchestra.run.smithi197.stderr: 92500K .......... .......... .......... .......... .......... 99% 119M 0s 2020-04-28T12:42:07.459 INFO:teuthology.orchestra.run.smithi197.stderr: 92550K .......... .......... .......... .......... .......... 99% 117M 0s 2020-04-28T12:42:07.459 INFO:teuthology.orchestra.run.smithi197.stderr: 92600K .......... .......... .......... .......... .......... 99% 109M 0s 2020-04-28T12:42:07.459 INFO:teuthology.orchestra.run.smithi197.stderr: 92650K .......... .......... .......... .......... .......... 99% 120M 0s 2020-04-28T12:42:07.459 INFO:teuthology.orchestra.run.smithi197.stderr: 92700K .......... .......... .......... .......... .......... 99% 114M 0s 2020-04-28T12:42:07.459 INFO:teuthology.orchestra.run.smithi197.stderr: 92750K .......... .......... .......... .......... .......... 99% 94.7M 0s 2020-04-28T12:42:07.460 INFO:teuthology.orchestra.run.smithi197.stderr: 92800K .......... .......... .......... .......... .......... 99% 117M 0s 2020-04-28T12:42:07.460 INFO:teuthology.orchestra.run.smithi197.stderr: 92850K .......... .......... .......... .......... .......... 99% 140M 0s 2020-04-28T12:42:07.460 INFO:teuthology.orchestra.run.smithi197.stderr: 92900K 100% 134G=0.9s 2020-04-28T12:42:07.460 INFO:teuthology.orchestra.run.smithi197.stderr: 2020-04-28T12:42:07.460 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28 12:42:06 (103 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2020-04-28T12:42:07.460 INFO:teuthology.orchestra.run.smithi197.stderr: 2020-04-28T12:42:07.460 INFO:teuthology.orchestra.run.smithi197.stdout:Archive: gradle-6.0.1-bin.zip 2020-04-28T12:42:07.461 INFO:teuthology.orchestra.run.smithi197.stdout: creating: /opt/gradle/gradle-6.0.1/ 2020-04-28T12:42:07.461 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2020-04-28T12:42:07.461 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2020-04-28T12:42:07.461 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2020-04-28T12:42:07.461 INFO:teuthology.orchestra.run.smithi197.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2020-04-28T12:42:07.461 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2020-04-28T12:42:07.461 INFO:teuthology.orchestra.run.smithi197.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2020-04-28T12:42:07.462 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2020-04-28T12:42:07.462 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2020-04-28T12:42:07.462 INFO:teuthology.orchestra.run.smithi197.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2020-04-28T12:42:07.462 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2020-04-28T12:42:07.462 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2020-04-28T12:42:07.462 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2020-04-28T12:42:07.463 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2020-04-28T12:42:07.463 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2020-04-28T12:42:07.463 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2020-04-28T12:42:07.463 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2020-04-28T12:42:07.463 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2020-04-28T12:42:07.463 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2020-04-28T12:42:07.463 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2020-04-28T12:42:07.464 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2020-04-28T12:42:07.464 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2020-04-28T12:42:07.464 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2020-04-28T12:42:07.464 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2020-04-28T12:42:07.464 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2020-04-28T12:42:07.464 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2020-04-28T12:42:07.464 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2020-04-28T12:42:07.465 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2020-04-28T12:42:07.465 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2020-04-28T12:42:07.465 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2020-04-28T12:42:07.465 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2020-04-28T12:42:07.465 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2020-04-28T12:42:07.465 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2020-04-28T12:42:07.465 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2020-04-28T12:42:07.466 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2020-04-28T12:42:07.466 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2020-04-28T12:42:07.466 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2020-04-28T12:42:07.466 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2020-04-28T12:42:07.466 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2020-04-28T12:42:07.466 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2020-04-28T12:42:07.466 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2020-04-28T12:42:07.481 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2020-04-28T12:42:07.481 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2020-04-28T12:42:07.481 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2020-04-28T12:42:07.481 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2020-04-28T12:42:07.481 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2020-04-28T12:42:07.482 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2020-04-28T12:42:07.482 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2020-04-28T12:42:07.482 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2020-04-28T12:42:07.482 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2020-04-28T12:42:07.482 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2020-04-28T12:42:07.482 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2020-04-28T12:42:07.482 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2020-04-28T12:42:07.483 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2020-04-28T12:42:07.483 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2020-04-28T12:42:07.483 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2020-04-28T12:42:07.483 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2020-04-28T12:42:07.483 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2020-04-28T12:42:07.483 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2020-04-28T12:42:07.484 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2020-04-28T12:42:07.484 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2020-04-28T12:42:07.484 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2020-04-28T12:42:07.484 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2020-04-28T12:42:07.484 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2020-04-28T12:42:07.484 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2020-04-28T12:42:07.484 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2020-04-28T12:42:07.485 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2020-04-28T12:42:07.485 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2020-04-28T12:42:07.485 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2020-04-28T12:42:07.485 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2020-04-28T12:42:07.485 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2020-04-28T12:42:07.485 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2020-04-28T12:42:07.485 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2020-04-28T12:42:07.486 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2020-04-28T12:42:07.486 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2020-04-28T12:42:07.486 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2020-04-28T12:42:07.486 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2020-04-28T12:42:07.486 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2020-04-28T12:42:07.486 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2020-04-28T12:42:07.486 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2020-04-28T12:42:07.487 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2020-04-28T12:42:07.487 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2020-04-28T12:42:07.487 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2020-04-28T12:42:07.487 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2020-04-28T12:42:07.487 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2020-04-28T12:42:07.487 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2020-04-28T12:42:07.488 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2020-04-28T12:42:07.488 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2020-04-28T12:42:07.488 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2020-04-28T12:42:07.488 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2020-04-28T12:42:07.488 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2020-04-28T12:42:07.488 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2020-04-28T12:42:07.488 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2020-04-28T12:42:07.489 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2020-04-28T12:42:07.489 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2020-04-28T12:42:07.489 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2020-04-28T12:42:07.489 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2020-04-28T12:42:07.489 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2020-04-28T12:42:07.489 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2020-04-28T12:42:07.489 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2020-04-28T12:42:07.490 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2020-04-28T12:42:07.490 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2020-04-28T12:42:07.490 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2020-04-28T12:42:07.490 INFO:teuthology.orchestra.run.smithi197.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2020-04-28T12:42:07.490 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2020-04-28T12:42:07.490 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2020-04-28T12:42:07.490 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2020-04-28T12:42:07.491 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2020-04-28T12:42:07.491 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2020-04-28T12:42:07.491 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2020-04-28T12:42:07.491 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2020-04-28T12:42:07.491 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2020-04-28T12:42:07.491 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2020-04-28T12:42:07.491 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2020-04-28T12:42:07.492 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2020-04-28T12:42:07.492 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2020-04-28T12:42:07.492 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2020-04-28T12:42:07.492 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2020-04-28T12:42:07.492 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2020-04-28T12:42:07.492 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2020-04-28T12:42:07.492 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2020-04-28T12:42:07.493 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2020-04-28T12:42:07.493 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2020-04-28T12:42:07.493 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2020-04-28T12:42:07.493 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2020-04-28T12:42:07.493 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2020-04-28T12:42:07.493 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2020-04-28T12:42:07.493 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2020-04-28T12:42:07.494 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2020-04-28T12:42:07.494 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2020-04-28T12:42:07.494 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2020-04-28T12:42:07.496 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2020-04-28T12:42:07.496 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2020-04-28T12:42:07.496 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2020-04-28T12:42:07.496 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2020-04-28T12:42:07.496 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2020-04-28T12:42:07.496 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2020-04-28T12:42:07.496 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2020-04-28T12:42:07.497 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2020-04-28T12:42:07.497 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2020-04-28T12:42:07.500 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2020-04-28T12:42:07.500 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2020-04-28T12:42:07.515 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2020-04-28T12:42:07.516 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2020-04-28T12:42:07.516 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2020-04-28T12:42:07.516 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2020-04-28T12:42:07.517 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2020-04-28T12:42:07.517 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2020-04-28T12:42:07.518 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2020-04-28T12:42:07.518 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2020-04-28T12:42:07.518 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2020-04-28T12:42:07.518 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2020-04-28T12:42:07.539 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2020-04-28T12:42:07.539 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2020-04-28T12:42:07.539 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2020-04-28T12:42:07.539 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2020-04-28T12:42:07.539 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2020-04-28T12:42:07.540 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2020-04-28T12:42:07.547 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2020-04-28T12:42:07.549 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2020-04-28T12:42:07.553 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2020-04-28T12:42:07.554 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2020-04-28T12:42:07.554 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2020-04-28T12:42:07.555 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2020-04-28T12:42:07.556 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2020-04-28T12:42:07.556 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2020-04-28T12:42:07.558 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2020-04-28T12:42:07.566 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2020-04-28T12:42:07.568 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2020-04-28T12:42:07.570 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2020-04-28T12:42:07.570 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2020-04-28T12:42:07.570 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2020-04-28T12:42:07.571 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2020-04-28T12:42:07.571 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2020-04-28T12:42:07.573 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2020-04-28T12:42:07.577 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2020-04-28T12:42:07.581 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2020-04-28T12:42:07.582 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2020-04-28T12:42:07.582 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2020-04-28T12:42:07.584 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2020-04-28T12:42:07.585 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2020-04-28T12:42:07.591 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2020-04-28T12:42:07.595 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2020-04-28T12:42:07.601 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2020-04-28T12:42:07.606 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2020-04-28T12:42:07.608 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2020-04-28T12:42:07.609 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2020-04-28T12:42:07.618 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2020-04-28T12:42:07.620 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2020-04-28T12:42:07.627 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2020-04-28T12:42:07.627 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2020-04-28T12:42:07.635 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2020-04-28T12:42:07.637 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2020-04-28T12:42:07.638 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2020-04-28T12:42:07.642 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2020-04-28T12:42:07.647 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2020-04-28T12:42:07.676 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2020-04-28T12:42:07.678 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2020-04-28T12:42:07.678 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2020-04-28T12:42:07.679 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2020-04-28T12:42:07.680 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2020-04-28T12:42:07.680 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2020-04-28T12:42:07.681 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2020-04-28T12:42:07.681 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2020-04-28T12:42:07.683 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2020-04-28T12:42:07.683 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2020-04-28T12:42:07.684 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2020-04-28T12:42:07.684 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2020-04-28T12:42:07.685 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2020-04-28T12:42:07.687 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2020-04-28T12:42:07.687 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2020-04-28T12:42:07.687 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2020-04-28T12:42:07.688 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2020-04-28T12:42:07.689 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2020-04-28T12:42:07.689 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2020-04-28T12:42:07.689 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2020-04-28T12:42:07.689 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2020-04-28T12:42:07.689 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2020-04-28T12:42:07.690 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2020-04-28T12:42:07.691 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2020-04-28T12:42:07.692 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2020-04-28T12:42:07.695 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2020-04-28T12:42:07.696 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2020-04-28T12:42:07.697 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2020-04-28T12:42:07.697 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2020-04-28T12:42:07.697 INFO:teuthology.orchestra.run.smithi197.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2020-04-28T12:42:07.737 INFO:teuthology.orchestra.run.smithi197.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2020-04-28T12:42:12.906 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.906 INFO:teuthology.orchestra.run.smithi197.stdout:Welcome to Gradle 6.0.1! 2020-04-28T12:42:12.906 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.906 INFO:teuthology.orchestra.run.smithi197.stdout:Here are the highlights of this release: 2020-04-28T12:42:12.907 INFO:teuthology.orchestra.run.smithi197.stdout: - Substantial improvements in dependency management, including 2020-04-28T12:42:12.907 INFO:teuthology.orchestra.run.smithi197.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2020-04-28T12:42:12.907 INFO:teuthology.orchestra.run.smithi197.stdout: - Advanced control of transitive versions 2020-04-28T12:42:12.907 INFO:teuthology.orchestra.run.smithi197.stdout: - Support for optional features and dependencies 2020-04-28T12:42:12.907 INFO:teuthology.orchestra.run.smithi197.stdout: - Rules to tweak published metadata 2020-04-28T12:42:12.907 INFO:teuthology.orchestra.run.smithi197.stdout: - Support for Java 13 2020-04-28T12:42:12.907 INFO:teuthology.orchestra.run.smithi197.stdout: - Faster incremental Java and Groovy compilation 2020-04-28T12:42:12.908 INFO:teuthology.orchestra.run.smithi197.stdout: - New Zinc compiler for Scala 2020-04-28T12:42:12.908 INFO:teuthology.orchestra.run.smithi197.stdout: - VS2019 support 2020-04-28T12:42:12.908 INFO:teuthology.orchestra.run.smithi197.stdout: - Support for Gradle Enterprise plugin 3.0 2020-04-28T12:42:12.908 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.908 INFO:teuthology.orchestra.run.smithi197.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2020-04-28T12:42:12.908 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.908 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.909 INFO:teuthology.orchestra.run.smithi197.stdout:------------------------------------------------------------ 2020-04-28T12:42:12.909 INFO:teuthology.orchestra.run.smithi197.stdout:Gradle 6.0.1 2020-04-28T12:42:12.911 INFO:teuthology.orchestra.run.smithi197.stdout:------------------------------------------------------------ 2020-04-28T12:42:12.911 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.911 INFO:teuthology.orchestra.run.smithi197.stdout:Build time: 2019-11-18 20:25:01 UTC 2020-04-28T12:42:12.911 INFO:teuthology.orchestra.run.smithi197.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2020-04-28T12:42:12.913 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.913 INFO:teuthology.orchestra.run.smithi197.stdout:Kotlin: 1.3.50 2020-04-28T12:42:12.914 INFO:teuthology.orchestra.run.smithi197.stdout:Groovy: 2.5.8 2020-04-28T12:42:12.914 INFO:teuthology.orchestra.run.smithi197.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2020-04-28T12:42:12.914 INFO:teuthology.orchestra.run.smithi197.stdout:JVM: 1.8.0_252 (Oracle Corporation 25.252-b09) 2020-04-28T12:42:12.914 INFO:teuthology.orchestra.run.smithi197.stdout:OS: Linux 4.18.0-147.8.1.el8_1.x86_64 amd64 2020-04-28T12:42:12.914 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:12.916 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:12.929 INFO:teuthology.orchestra.run.smithi197:> sudo keytool -import -alias smithi197.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2020-04-28T12:42:13.352 INFO:teuthology.orchestra.run.smithi197.stderr:Certificate was added to keystore 2020-04-28T12:42:13.375 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2020-04-28T12:42:13.375 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T12:42:13.376 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi197.front.sepia.ceph.com 2020-04-28T12:42:13.376 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T12:42:13.376 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi066.front.sepia.ceph.com 2020-04-28T12:42:13.376 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2020-04-28T12:42:13.582 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2020-04-28T12:42:13.582 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2020-04-28T12:42:13.583 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'CDNDOWMCZOEHVGZNEUIX', 's3dir': 'folder', 'endpoint': 'smithi197.front.sepia.ceph.com:443', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 443, 'access_secret': '16dhmWsRH4wIZ/rvwuDiCwQL3TFcrmyRpAfI1k441VxLfesfnZ3Kuw==', 'host': 'smithi197.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': True, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2020-04-28T12:42:13.583 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2020-04-28T12:42:13.583 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'CDNDOWMCZOEHVGZNEUIX', '--secret', '16dhmWsRH4wIZ/rvwuDiCwQL3TFcrmyRpAfI1k441VxLfesfnZ3Kuw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2020-04-28T12:42:13.583 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:13.597 INFO:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key CDNDOWMCZOEHVGZNEUIX --secret 16dhmWsRH4wIZ/rvwuDiCwQL3TFcrmyRpAfI1k441VxLfesfnZ3Kuw== --email tester.client.0_test@test.test --cluster ceph 2020-04-28T12:42:13.685 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.680+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.682+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.687 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.682+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.683+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.683+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.683+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.688 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.683+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.689 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.684+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:13.733 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.700+0000 7ff9092d1180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:42:13.733 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.700+0000 7ff9092d1180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:42:13.734 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.700+0000 7ff9092d1180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:42:13.734 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.700+0000 7ff9092d1180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:42:13.734 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.700+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.734 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.701+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:13.734 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.701+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.734 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.701+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:42:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.701+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.702+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.702+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.702+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:42:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.702+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.703+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.703+0000 7ff9092d1180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:42:13.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.703+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.703+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.703+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.703+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:13.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.703+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.704+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:42:13.736 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.704+0000 7ff9092d1180 20 zonegroup default 2020-04-28T12:42:13.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.704+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.704+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.704+0000 7ff9092d1180 10 Cannot find current period zone using local zone 2020-04-28T12:42:13.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.704+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.705+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.705+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.705+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:13.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.705+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.705+0000 7ff9092d1180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:42:13.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.705+0000 7ff9092d1180 20 zone default found 2020-04-28T12:42:13.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.706+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.742 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.706+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.742 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.706+0000 7ff9092d1180 20 rados->read ofs=0 len=0 2020-04-28T12:42:13.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.706+0000 7ff9092d1180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:13.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.706+0000 7ff9092d1180 20 started sync module instance, tier type = 2020-04-28T12:42:13.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.706+0000 7ff9092d1180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:42:13.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.711+0000 7ff8f6ac4700 0 -- 172.21.15.197:0/443547601 >> [v2:172.21.15.66:6808/23254,v1:172.21.15.66:6809/23254] conn(0x55582e850aa0 msgr2=0x55582e852f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:42:13.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.718+0000 7ff9092d1180 20 add_watcher() i=0 2020-04-28T12:42:13.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.718+0000 7ff9092d1180 20 add_watcher() i=1 2020-04-28T12:42:13.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.718+0000 7ff9092d1180 20 add_watcher() i=2 2020-04-28T12:42:13.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.718+0000 7ff9092d1180 20 add_watcher() i=3 2020-04-28T12:42:13.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.718+0000 7ff9092d1180 20 add_watcher() i=4 2020-04-28T12:42:13.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.718+0000 7ff9092d1180 20 add_watcher() i=5 2020-04-28T12:42:13.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.718+0000 7ff9092d1180 20 add_watcher() i=6 2020-04-28T12:42:13.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.719+0000 7ff9092d1180 20 add_watcher() i=7 2020-04-28T12:42:13.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.719+0000 7ff9092d1180 2 all 8 watchers are set, enabling cache 2020-04-28T12:42:13.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.719+0000 7ff9092d1180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:42:13.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.719+0000 7ff9092d1180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:42:13.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.719+0000 7ff8c7fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:42:13.745 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.720+0000 7ff8f72c5700 0 -- 172.21.15.197:0/2543506333 >> v1:172.21.15.197:6789/0 conn(0x55582e86b370 legacy=0x55582e86b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:42:13.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.769+0000 7ff8367fc700 20 reqs_thread_entry: start 2020-04-28T12:42:13.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.770+0000 7ff82ffff700 20 reqs_thread_entry: start 2020-04-28T12:42:13.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.770+0000 7ff9092d1180 20 init_complete bucket index max shards: 1999 2020-04-28T12:42:13.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.770+0000 7ff82e7fc700 20 reqs_thread_entry: start 2020-04-28T12:42:13.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.770+0000 7ff9092d1180 20 get_system_obj_state: rctx=0x7fff6b893f88 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55582e717040 s->prefetch_data=0 2020-04-28T12:42:13.776 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.770+0000 7ff9092d1180 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2020-04-28T12:42:13.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2020-04-28T12:42:13.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:42:13.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 20 get_system_obj_state: rctx=0x7fff6b893f98 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55582e717040 s->prefetch_data=0 2020-04-28T12:42:13.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2020-04-28T12:42:13.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2020-04-28T12:42:13.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:42:13.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 20 get_system_obj_state: rctx=0x7fff6b893f98 obj=default.rgw.meta:users.keys:CDNDOWMCZOEHVGZNEUIX state=0x55582e717040 s->prefetch_data=0 2020-04-28T12:42:13.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 cache get: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX : miss 2020-04-28T12:42:13.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX info.flags=0x0 2020-04-28T12:42:13.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 adding default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX to cache LRU end 2020-04-28T12:42:13.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 20 get_system_obj_state: rctx=0x7fff6b8939a8 obj=default.rgw.meta:users.keys:CDNDOWMCZOEHVGZNEUIX state=0x55582e717040 s->prefetch_data=0 2020-04-28T12:42:13.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.771+0000 7ff9092d1180 10 cache get: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX : type miss (requested=0x6, cached=0x0) 2020-04-28T12:42:13.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.772+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX info.flags=0x0 2020-04-28T12:42:13.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.772+0000 7ff9092d1180 10 moving default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX to cache LRU end 2020-04-28T12:42:13.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.772+0000 7ff9092d1180 20 get_system_obj_state: rctx=0x7fff6b893c98 obj=default.rgw.meta:users.keys:CDNDOWMCZOEHVGZNEUIX state=0x55582e717040 s->prefetch_data=0 2020-04-28T12:42:13.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.772+0000 7ff9092d1180 10 cache get: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX : type miss (requested=0x6, cached=0x0) 2020-04-28T12:42:13.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.772+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX info.flags=0x0 2020-04-28T12:42:13.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.772+0000 7ff9092d1180 10 moving default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX to cache LRU end 2020-04-28T12:42:13.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.774+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T12:42:13.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.774+0000 7ff9092d1180 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:42:13.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.774+0000 7ff9092d1180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2020-04-28T12:42:13.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.774+0000 7ff8dcff9700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 93837226009408 notifier 4550 bl.length()=632 2020-04-28T12:42:13.780 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.774+0000 7ff8dcff9700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T12:42:13.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.774+0000 7ff8dcff9700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:42:13.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.776+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T12:42:13.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.776+0000 7ff9092d1180 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:42:13.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.776+0000 7ff9092d1180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2020-04-28T12:42:13.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.776+0000 7ff8dcff9700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 93837225955088 notifier 4550 bl.length()=200 2020-04-28T12:42:13.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.776+0000 7ff8dcff9700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T12:42:13.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.776+0000 7ff8dcff9700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:42:13.786 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.778+0000 7ff9092d1180 10 cache put: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX info.flags=0x7 2020-04-28T12:42:13.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.778+0000 7ff9092d1180 10 moving default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX to cache LRU end 2020-04-28T12:42:13.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.778+0000 7ff9092d1180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=189 2020-04-28T12:42:13.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.779+0000 7ff8dcff9700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 93837226000384 notifier 4550 bl.length()=189 2020-04-28T12:42:13.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.779+0000 7ff8dcff9700 10 cache put: name=default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX info.flags=0x7 2020-04-28T12:42:13.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.779+0000 7ff8dcff9700 10 moving default.rgw.meta+users.keys+CDNDOWMCZOEHVGZNEUIX to cache LRU end 2020-04-28T12:42:13.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.780+0000 7ff8c7fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:42:13.788 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.781+0000 7ff9092d1180 20 remove_watcher() i=0 2020-04-28T12:42:13.788 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.781+0000 7ff9092d1180 2 removed watcher, disabling cache 2020-04-28T12:42:13.788 INFO:teuthology.orchestra.run.smithi197.stdout:{ 2020-04-28T12:42:13.788 INFO:teuthology.orchestra.run.smithi197.stdout: "user_id": "tester.client.0", 2020-04-28T12:42:13.788 INFO:teuthology.orchestra.run.smithi197.stdout: "display_name": "Ms. tester.client.0", 2020-04-28T12:42:13.788 INFO:teuthology.orchestra.run.smithi197.stdout: "email": "tester.client.0_test@test.test", 2020-04-28T12:42:13.789 INFO:teuthology.orchestra.run.smithi197.stdout: "suspended": 0, 2020-04-28T12:42:13.789 INFO:teuthology.orchestra.run.smithi197.stdout: "max_buckets": 1000, 2020-04-28T12:42:13.789 INFO:teuthology.orchestra.run.smithi197.stdout: "subusers": [], 2020-04-28T12:42:13.789 INFO:teuthology.orchestra.run.smithi197.stdout: "keys": [ 2020-04-28T12:42:13.789 INFO:teuthology.orchestra.run.smithi197.stdout: { 2020-04-28T12:42:13.789 INFO:teuthology.orchestra.run.smithi197.stdout: "user": "tester.client.0", 2020-04-28T12:42:13.789 INFO:teuthology.orchestra.run.smithi197.stdout: "access_key": "CDNDOWMCZOEHVGZNEUIX", 2020-04-28T12:42:13.790 INFO:teuthology.orchestra.run.smithi197.stdout: "secret_key": "16dhmWsRH4wIZ/rvwuDiCwQL3TFcrmyRpAfI1k441VxLfesfnZ3Kuw==" 2020-04-28T12:42:13.790 INFO:teuthology.orchestra.run.smithi197.stdout: } 2020-04-28T12:42:13.790 INFO:teuthology.orchestra.run.smithi197.stdout: ], 2020-04-28T12:42:13.790 INFO:teuthology.orchestra.run.smithi197.stdout: "swift_keys": [], 2020-04-28T12:42:13.790 INFO:teuthology.orchestra.run.smithi197.stdout: "caps": [], 2020-04-28T12:42:13.790 INFO:teuthology.orchestra.run.smithi197.stdout: "op_mask": "read, write, delete", 2020-04-28T12:42:13.790 INFO:teuthology.orchestra.run.smithi197.stdout: "default_placement": "", 2020-04-28T12:42:13.791 INFO:teuthology.orchestra.run.smithi197.stdout: "default_storage_class": "", 2020-04-28T12:42:13.791 INFO:teuthology.orchestra.run.smithi197.stdout: "placement_tags": [], 2020-04-28T12:42:13.791 INFO:teuthology.orchestra.run.smithi197.stdout: "bucket_quota": { 2020-04-28T12:42:13.791 INFO:teuthology.orchestra.run.smithi197.stdout: "enabled": false, 2020-04-28T12:42:13.791 INFO:teuthology.orchestra.run.smithi197.stdout: "check_on_raw": false, 2020-04-28T12:42:13.791 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size": -1, 2020-04-28T12:42:13.791 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size_kb": 0, 2020-04-28T12:42:13.792 INFO:teuthology.orchestra.run.smithi197.stdout: "max_objects": -1 2020-04-28T12:42:13.792 INFO:teuthology.orchestra.run.smithi197.stdout: }, 2020-04-28T12:42:13.792 INFO:teuthology.orchestra.run.smithi197.stdout: "user_quota": { 2020-04-28T12:42:13.792 INFO:teuthology.orchestra.run.smithi197.stdout: "enabled": false, 2020-04-28T12:42:13.792 INFO:teuthology.orchestra.run.smithi197.stdout: "check_on_raw": false, 2020-04-28T12:42:13.792 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size": -1, 2020-04-28T12:42:13.792 INFO:teuthology.orchestra.run.smithi197.stdout: "max_size_kb": 0, 2020-04-28T12:42:13.793 INFO:teuthology.orchestra.run.smithi197.stdout: "max_objects": -1 2020-04-28T12:42:13.793 INFO:teuthology.orchestra.run.smithi197.stdout: }, 2020-04-28T12:42:13.793 INFO:teuthology.orchestra.run.smithi197.stdout: "temp_url_keys": [], 2020-04-28T12:42:13.793 INFO:teuthology.orchestra.run.smithi197.stdout: "type": "rgw", 2020-04-28T12:42:13.793 INFO:teuthology.orchestra.run.smithi197.stdout: "mfa_ids": [] 2020-04-28T12:42:13.793 INFO:teuthology.orchestra.run.smithi197.stdout:} 2020-04-28T12:42:13.794 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:13.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.783+0000 7ff9092d1180 20 remove_watcher() i=1 2020-04-28T12:42:13.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.784+0000 7ff9092d1180 20 remove_watcher() i=2 2020-04-28T12:42:13.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.785+0000 7ff9092d1180 20 remove_watcher() i=3 2020-04-28T12:42:13.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.786+0000 7ff9092d1180 20 remove_watcher() i=4 2020-04-28T12:42:13.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.787+0000 7ff9092d1180 20 remove_watcher() i=5 2020-04-28T12:42:13.812 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.788+0000 7ff9092d1180 20 remove_watcher() i=6 2020-04-28T12:42:13.813 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:13.789+0000 7ff9092d1180 20 remove_watcher() i=7 2020-04-28T12:42:13.816 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:13.840 INFO:teuthology.orchestra.run.smithi197:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2020-04-28T12:42:13.934 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2020-04-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:13.979 INFO:teuthology.orchestra.run.smithi197:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2020-04-28T12:42:14.033 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:14.086 INFO:teuthology.orchestra.run.smithi197:> radosgw-admin gc process --include-all 2020-04-28T12:42:14.164 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.160+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.166 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.161+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.166 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.161+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.167 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.162+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.167 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.162+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.167 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.162+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.167 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.162+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.168 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.163+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.180+0000 7f30f7416180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.180+0000 7f30f7416180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.180+0000 7f30f7416180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.180+0000 7f30f7416180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.180+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.186 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.180+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.186 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.180+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.187 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.181+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:42:14.187 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.181+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.187 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.181+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.187 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.181+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.182+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.182+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.182+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.182+0000 7f30f7416180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.182+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.183+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.189 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.183+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.190 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.190 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.190 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:42:14.190 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 20 zonegroup default 2020-04-28T12:42:14.190 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.190 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.191 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 10 Cannot find current period zone using local zone 2020-04-28T12:42:14.191 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.184+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.191 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.185+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.191 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.185+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.191 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.185+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.192 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.185+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.193 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:42:14.193 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 zone default found 2020-04-28T12:42:14.193 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.193 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.193 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.194 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.194 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 started sync module instance, tier type = 2020-04-28T12:42:14.194 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.186+0000 7f30f7416180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:42:14.194 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.189+0000 7f30e5c0b700 0 -- 172.21.15.197:0/1845488649 >> [v2:172.21.15.66:6816/23329,v1:172.21.15.66:6817/23329] conn(0x7f30dc03f260 msgr2=0x7f30dc0029e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:42:14.206 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.197+0000 7f30f7416180 20 add_watcher() i=0 2020-04-28T12:42:14.206 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.197+0000 7f30f7416180 20 add_watcher() i=1 2020-04-28T12:42:14.206 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.197+0000 7f30f7416180 20 add_watcher() i=2 2020-04-28T12:42:14.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.197+0000 7f30f7416180 20 add_watcher() i=3 2020-04-28T12:42:14.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.197+0000 7f30f7416180 20 add_watcher() i=4 2020-04-28T12:42:14.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.197+0000 7f30f7416180 20 add_watcher() i=5 2020-04-28T12:42:14.207 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.197+0000 7f30f7416180 20 add_watcher() i=6 2020-04-28T12:42:14.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.199+0000 7f30f7416180 20 add_watcher() i=7 2020-04-28T12:42:14.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.199+0000 7f30f7416180 2 all 8 watchers are set, enabling cache 2020-04-28T12:42:14.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.199+0000 7f30f7416180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:42:14.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.199+0000 7f30f7416180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:42:14.208 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.199+0000 7f30b5fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:42:14.209 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.201+0000 7f30e5c0b700 0 -- 172.21.15.197:0/3032359437 >> v1:172.21.15.66:6789/0 conn(0x55c2132a6280 legacy=0x55c213282300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2020-04-28T12:42:14.257 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.252+0000 7f3027fff700 20 reqs_thread_entry: start 2020-04-28T12:42:14.257 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.252+0000 7f3025ffb700 20 reqs_thread_entry: start 2020-04-28T12:42:14.258 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.252+0000 7f30f7416180 20 init_complete bucket index max shards: 1999 2020-04-28T12:42:14.258 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.252+0000 7f3013fff700 20 reqs_thread_entry: start 2020-04-28T12:42:14.258 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.252+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T12:42:14.259 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.254+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.260 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.255+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.261 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:42:14.261 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.243', time=2020-04-28T14:41:45.700143+0000, chain.objs.size()=3 2020-04-28T12:42:14.261 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-STANDARD.2~vqZjPAuELaboPNavSHyTI7grCmfvpH_.1 2020-04-28T12:42:14.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-STANDARD.2~vqZjPAuELaboPNavSHyTI7grCmfvpH_.2 2020-04-28T12:42:14.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-STANDARD.2~vqZjPAuELaboPNavSHyTI7grCmfvpH_.3 2020-04-28T12:42:14.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.84', time=2020-04-28T14:41:49.532574+0000, chain.objs.size()=2 2020-04-28T12:42:14.262 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6__shadow_.aihVdud_QIfWqPdaRRw3P3J-qEMEabG_0 2020-04-28T12:42:14.263 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.256+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6__shadow_.aihVdud_QIfWqPdaRRw3P3J-qEMEabG_1 2020-04-28T12:42:14.264 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.259+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.266 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.262+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T12:42:14.268 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.264+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.269 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.265+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.270 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.265+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.271 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.267+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T12:42:14.273 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.269+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.274 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.270+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.275 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.270+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.276 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.270+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_GEtcd73BUxqcgwHkMvwEQRS3wJBzUSB', time=2020-04-28T14:41:45.694305+0000, chain.objs.size()=2 2020-04-28T12:42:14.276 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.270+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.estZAwqZI_vCg0wOyvvx8hmtp1y0WUv_0 2020-04-28T12:42:14.276 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.270+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.estZAwqZI_vCg0wOyvvx8hmtp1y0WUv_1 2020-04-28T12:42:14.277 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.272+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.279 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.275+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T12:42:14.281 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.276+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.281 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.277+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.282 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.277+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.282 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.277+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.108', time=2020-04-28T14:41:43.741140+0000, chain.objs.size()=1 2020-04-28T12:42:14.283 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.277+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.Q00Y9MYsyvwqqeaAF-_xO023m1aMN07_0 2020-04-28T12:42:14.283 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.279+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.286 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.281+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T12:42:14.287 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.283+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.289 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.284+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.289 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.284+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.291 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.286+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T12:42:14.292 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.288+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.293 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.288+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.293 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.289+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.294 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.289+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_D3JdJu4lh0nY4EVSQasfoDXsjoAhDMw', time=2020-04-28T14:41:45.670177+0000, chain.objs.size()=1 2020-04-28T12:42:14.294 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.289+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.hd0OvQ7HXTEM9mhW6xtKlmgygu4IyDU_0 2020-04-28T12:42:14.295 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.290+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.297 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.293+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T12:42:14.299 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.294+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.299 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.295+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.300 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.295+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.301 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.296+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T12:42:14.303 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.298+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.304 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.299+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.300+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:42:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.300+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_13aWve8zq4EYlpagp3bSy0qm1Isoed_', time=2020-04-28T14:41:43.734912+0000, chain.objs.size()=1 2020-04-28T12:42:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.300+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.Z_f6le9ClbtQUpn6q4uMzX_gxzvyTv3_1 2020-04-28T12:42:14.305 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.300+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.204', time=2020-04-28T14:41:47.667746+0000, chain.objs.size()=3 2020-04-28T12:42:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.300+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-LUKEWARM.2~lxzeyxGLCQOPmLWIpJRJZWUfY04rFEd.1 2020-04-28T12:42:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.300+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-LUKEWARM.2~lxzeyxGLCQOPmLWIpJRJZWUfY04rFEd.2 2020-04-28T12:42:14.306 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.300+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-LUKEWARM.2~lxzeyxGLCQOPmLWIpJRJZWUfY04rFEd.3 2020-04-28T12:42:14.308 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.303+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.310 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.306+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T12:42:14.313 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.308+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.313 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.309+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.314 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.309+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.314 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.309+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.55', time=2020-04-28T14:41:40.018298+0000, chain.objs.size()=4 2020-04-28T12:42:14.315 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.309+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4__multipart_foo.2~ndXJNPyvpi5-60ETiaC_qzqkPk1s52X.1 2020-04-28T12:42:14.315 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.309+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4__multipart_foo.2~ndXJNPyvpi5-60ETiaC_qzqkPk1s52X.2 2020-04-28T12:42:14.315 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.309+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4__multipart_foo.2~ndXJNPyvpi5-60ETiaC_qzqkPk1s52X.3 2020-04-28T12:42:14.315 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.309+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.4__multipart_foo.2~ndXJNPyvpi5-60ETiaC_qzqkPk1s52X.4 2020-04-28T12:42:14.317 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.313+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.320 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.316+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T12:42:14.322 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.317+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.322 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.323 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:42:14.323 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.116', time=2020-04-28T14:41:43.775878+0000, chain.objs.size()=1 2020-04-28T12:42:14.324 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.e2x7tqKuI5N7hFNPlIv8l2ERqkR3q51_1 2020-04-28T12:42:14.324 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.226', time=2020-04-28T14:41:45.711574+0000, chain.objs.size()=3 2020-04-28T12:42:14.324 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-FROZEN.2~Jx05MORm7Zeam3X1BdP9mrV8Qr1n7qw.1 2020-04-28T12:42:14.324 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-FROZEN.2~Jx05MORm7Zeam3X1BdP9mrV8Qr1n7qw.2 2020-04-28T12:42:14.324 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.318+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-FROZEN.2~Jx05MORm7Zeam3X1BdP9mrV8Qr1n7qw.3 2020-04-28T12:42:14.325 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.320+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.327 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.323+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T12:42:14.329 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.325+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.330 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.325+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.331 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:42:14.331 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.234', time=2020-04-28T14:41:45.646652+0000, chain.objs.size()=3 2020-04-28T12:42:14.331 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-LUKEWARM.2~A3p62fIKk1QjyazbcesXF6K0xGkefHl.1 2020-04-28T12:42:14.331 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-LUKEWARM.2~A3p62fIKk1QjyazbcesXF6K0xGkefHl.2 2020-04-28T12:42:14.331 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-LUKEWARM.2~A3p62fIKk1QjyazbcesXF6K0xGkefHl.3 2020-04-28T12:42:14.332 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.236', time=2020-04-28T14:41:45.652688+0000, chain.objs.size()=3 2020-04-28T12:42:14.332 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-LUKEWARM.2~A3p62fIKk1QjyazbcesXF6K0xGkefHl.1 2020-04-28T12:42:14.332 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-LUKEWARM.2~A3p62fIKk1QjyazbcesXF6K0xGkefHl.2 2020-04-28T12:42:14.332 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.326+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-LUKEWARM.2~A3p62fIKk1QjyazbcesXF6K0xGkefHl.3 2020-04-28T12:42:14.334 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.330+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.337 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.333+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T12:42:14.339 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.334+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.340 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.335+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2020-04-28T12:42:14.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_qhdwdvJeDH-qYWW7bzzpd4H2iOB27R_', time=2020-04-28T14:41:43.758512+0000, chain.objs.size()=1 2020-04-28T12:42:14.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.1fIN3aDCKW55Yh7T5A2H7XhsvmsCfRZ_1 2020-04-28T12:42:14.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_0Kvaboie-rx9i-C4UyhP6guqISugPqZ', time=2020-04-28T14:41:43.781459+0000, chain.objs.size()=1 2020-04-28T12:42:14.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.9vX1MlGQRPflRdhe87JW9lGBjfdZRtN_0 2020-04-28T12:42:14.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.246', time=2020-04-28T14:41:45.688315+0000, chain.objs.size()=3 2020-04-28T12:42:14.341 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-STANDARD.2~vqZjPAuELaboPNavSHyTI7grCmfvpH_.1 2020-04-28T12:42:14.342 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-STANDARD.2~vqZjPAuELaboPNavSHyTI7grCmfvpH_.2 2020-04-28T12:42:14.342 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-STANDARD.2~vqZjPAuELaboPNavSHyTI7grCmfvpH_.3 2020-04-28T12:42:14.342 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_dWC4T7WUVNMOkv17CKs98RyOdfg5xp-', time=2020-04-28T14:41:45.705873+0000, chain.objs.size()=1 2020-04-28T12:42:14.342 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.XNSRK6yxpMG-4dJkMTh1yJgCR3_CAmG_0 2020-04-28T12:42:14.343 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.197', time=2020-04-28T14:41:47.674608+0000, chain.objs.size()=3 2020-04-28T12:42:14.343 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-FROZEN.2~sRPHYTWcWgV0zCReXimjm_cRAEhuSqw.1 2020-04-28T12:42:14.343 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-FROZEN.2~sRPHYTWcWgV0zCReXimjm_cRAEhuSqw.2 2020-04-28T12:42:14.343 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.336+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-FROZEN.2~sRPHYTWcWgV0zCReXimjm_cRAEhuSqw.3 2020-04-28T12:42:14.344 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.340+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.347 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.343+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T12:42:14.349 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.344+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.350 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.345+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.350 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.346+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.352 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.348+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T12:42:14.354 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.349+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.354 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.350+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.355 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.350+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.355 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.350+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_z69KIc8QEqgY_aiw8Ym0oFBAfewt4nE', time=2020-04-28T14:41:43.752798+0000, chain.objs.size()=1 2020-04-28T12:42:14.355 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.350+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_._gER1l128D64MqP7gE8VMnoVwMMW2f5_0 2020-04-28T12:42:14.356 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.352+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.359 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.354+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T12:42:14.360 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.356+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.361 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.362 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T12:42:14.362 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.112', time=2020-04-28T14:41:43.710221+0000, chain.objs.size()=1 2020-04-28T12:42:14.362 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.FJKZGokT9Yp4Fr4RLAWLdMWDh4zIQhr_0 2020-04-28T12:42:14.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.114', time=2020-04-28T14:41:43.717338+0000, chain.objs.size()=1 2020-04-28T12:42:14.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.FJKZGokT9Yp4Fr4RLAWLdMWDh4zIQhr_0 2020-04-28T12:42:14.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_f-0hs1H_Y2aOjiDgHpEn4zkd5Wow4eK', time=2020-04-28T14:41:45.682510+0000, chain.objs.size()=2 2020-04-28T12:42:14.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.E6YFk6Tjp4c3X1aKlzYl5jFQ_mWgHiA_1 2020-04-28T12:42:14.363 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.357+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.E6YFk6Tjp4c3X1aKlzYl5jFQ_mWgHiA_2 2020-04-28T12:42:14.365 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.360+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.367 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.363+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T12:42:14.369 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.365+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.365+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.370 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.366+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.372 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.367+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T12:42:14.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.369+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.374 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.370+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.370+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.370+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.85', time=2020-04-28T14:41:49.526099+0000, chain.objs.size()=2 2020-04-28T12:42:14.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.370+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6__shadow_.T26uKK08grKIEKvvmpWAXrCMbCMAf2T_0 2020-04-28T12:42:14.375 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.370+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.6__shadow_.T26uKK08grKIEKvvmpWAXrCMbCMAf2T_1 2020-04-28T12:42:14.376 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.372+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.379 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.374+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T12:42:14.380 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.376+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.381 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.377+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.382 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.377+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.384 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.378+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T12:42:14.385 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.380+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.385 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.381+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.386 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.381+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:42:14.386 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.381+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_3_0XLj2BQgFnvcEZnyb1_zyExCBJxbC', time=2020-04-28T14:41:43.747089+0000, chain.objs.size()=1 2020-04-28T12:42:14.387 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.381+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.iEWNefP4pk482Iu8fU1CO24FDW6_eov_0 2020-04-28T12:42:14.387 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.381+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_P2IDxroA8mUJsO3fzJISrWbBIfhTGZe', time=2020-04-28T14:41:45.659040+0000, chain.objs.size()=2 2020-04-28T12:42:14.387 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.381+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.HB8uim8DhjcHw00iUFYHCx814KYuPln_1 2020-04-28T12:42:14.387 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.382+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.HB8uim8DhjcHw00iUFYHCx814KYuPln_2 2020-04-28T12:42:14.388 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.384+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.391 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.387+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T12:42:14.393 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.388+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.394 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.389+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.394 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.390+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.395 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.390+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.109', time=2020-04-28T14:41:43.787226+0000, chain.objs.size()=1 2020-04-28T12:42:14.395 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.390+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.Q00Y9MYsyvwqqeaAF-_xO023m1aMN07_0 2020-04-28T12:42:14.395 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.391+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.399 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.394+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T12:42:14.401 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.396+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.402 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.397+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.403 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.397+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:42:14.403 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.397+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.71', time=2020-04-28T14:41:41.840902+0000, chain.objs.size()=4 2020-04-28T12:42:14.403 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.397+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5__multipart_foo.2~_V2cfL9eXjvG4SisHuZuW3_vZsZzjUL.1 2020-04-28T12:42:14.403 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.397+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5__multipart_foo.2~_V2cfL9eXjvG4SisHuZuW3_vZsZzjUL.2 2020-04-28T12:42:14.403 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.397+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5__multipart_foo.2~_V2cfL9eXjvG4SisHuZuW3_vZsZzjUL.3 2020-04-28T12:42:14.403 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.398+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.5__multipart_foo.2~_V2cfL9eXjvG4SisHuZuW3_vZsZzjUL.4 2020-04-28T12:42:14.404 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.398+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.119', time=2020-04-28T14:41:43.764121+0000, chain.objs.size()=1 2020-04-28T12:42:14.404 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.398+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.e2x7tqKuI5N7hFNPlIv8l2ERqkR3q51_1 2020-04-28T12:42:14.405 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.401+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.410 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.405+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T12:42:14.412 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.407+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.413 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.408+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.413 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.408+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.414 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.410+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T12:42:14.416 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.412+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.417 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.413+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.418 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.413+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.418 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.413+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_Uqc_IxLsshWqjXvXW7SfwO-zy_IKNEf', time=2020-04-28T14:41:43.770107+0000, chain.objs.size()=1 2020-04-28T12:42:14.418 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.413+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.7__shadow_.aWjGCjziDKqyVGjgAMa21y2u_W1Idui_0 2020-04-28T12:42:14.419 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.415+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.422 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.417+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T12:42:14.423 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.419+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.424 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.420+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.425 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.420+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.425 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.421+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T12:42:14.427 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.423+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.428 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.424+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.429 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.424+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.430 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.426+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T12:42:14.432 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.427+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.433 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.428+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.433 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.428+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.433 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.428+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.225', time=2020-04-28T14:41:45.664621+0000, chain.objs.size()=3 2020-04-28T12:42:14.434 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.428+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-FROZEN.2~Jx05MORm7Zeam3X1BdP9mrV8Qr1n7qw.1 2020-04-28T12:42:14.434 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.428+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-FROZEN.2~Jx05MORm7Zeam3X1BdP9mrV8Qr1n7qw.2 2020-04-28T12:42:14.434 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.429+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__multipart_foo-FROZEN.2~Jx05MORm7Zeam3X1BdP9mrV8Qr1n7qw.3 2020-04-28T12:42:14.435 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.430+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.437 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.433+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T12:42:14.439 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.434+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.439 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.435+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.440 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.435+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.440 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.435+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.20', time=2020-04-28T14:41:36.377961+0000, chain.objs.size()=4 2020-04-28T12:42:14.441 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.435+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2__multipart_foo.2~UJY8qotKIXRuOfYN5lrFNE_8dEoYUSs.1 2020-04-28T12:42:14.441 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.436+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2__multipart_foo.2~UJY8qotKIXRuOfYN5lrFNE_8dEoYUSs.2 2020-04-28T12:42:14.441 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.436+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2__multipart_foo.2~UJY8qotKIXRuOfYN5lrFNE_8dEoYUSs.3 2020-04-28T12:42:14.441 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.436+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.2__multipart_foo.2~UJY8qotKIXRuOfYN5lrFNE_8dEoYUSs.4 2020-04-28T12:42:14.443 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.439+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.447 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.442+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T12:42:14.451 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.446+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.451 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.447+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.452 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.447+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.453 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.448+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T12:42:14.455 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.451+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.456 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.452+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.457 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.452+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:42:14.458 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.452+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.40', time=2020-04-28T14:41:38.213411+0000, chain.objs.size()=4 2020-04-28T12:42:14.458 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.452+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3__multipart_foo.2~li15qE4seAqbrA761VvPStTKJp0D1lz.1 2020-04-28T12:42:14.458 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.452+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3__multipart_foo.2~li15qE4seAqbrA761VvPStTKJp0D1lz.2 2020-04-28T12:42:14.458 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.452+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3__multipart_foo.2~li15qE4seAqbrA761VvPStTKJp0D1lz.3 2020-04-28T12:42:14.458 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.452+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.3__multipart_foo.2~li15qE4seAqbrA761VvPStTKJp0D1lz.4 2020-04-28T12:42:14.460 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.456+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.464 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.459+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T12:42:14.466 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.461+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.466 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.467 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:42:14.467 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='_nwDy4BJ1x48K6b7K-8qOweQh8Hducm3', time=2020-04-28T14:41:45.675888+0000, chain.objs.size()=2 2020-04-28T12:42:14.468 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.O8Zt98ZtWB2kErlg6QNfJ4rznXyjEg4_0 2020-04-28T12:42:14.468 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.9__shadow_.O8Zt98ZtWB2kErlg6QNfJ4rznXyjEg4_1 2020-04-28T12:42:14.468 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 20 garbage collection: RGWGC::process iterating over entry tag='e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4630.211', time=2020-04-28T14:41:47.681106+0000, chain.objs.size()=3 2020-04-28T12:42:14.468 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-STANDARD.2~f2wGYB2CVBeuqRwtTzFXInHxamXkRJ2.1 2020-04-28T12:42:14.468 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-STANDARD.2~f2wGYB2CVBeuqRwtTzFXInHxamXkRJ2.2 2020-04-28T12:42:14.468 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.462+0000 7f30f7416180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e178e290-c1ed-49b6-b9ff-4b37e8f78ff2.4639.8__multipart_foo-STANDARD.2~f2wGYB2CVBeuqRwtTzFXInHxamXkRJ2.3 2020-04-28T12:42:14.471 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.466+0000 7f30f7416180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:42:14.474 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.469+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T12:42:14.476 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.471+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.476 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.472+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.477 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.473+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.478 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.474+0000 7f30f7416180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T12:42:14.480 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.476+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.481 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.477+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.482 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.477+0000 7f30f7416180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.483 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.478+0000 7f30b5fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:42:14.485 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.480+0000 7f30f7416180 20 remove_watcher() i=0 2020-04-28T12:42:14.485 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.480+0000 7f30f7416180 2 removed watcher, disabling cache 2020-04-28T12:42:14.486 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.481+0000 7f30f7416180 20 remove_watcher() i=1 2020-04-28T12:42:14.487 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.483+0000 7f30f7416180 20 remove_watcher() i=2 2020-04-28T12:42:14.488 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.484+0000 7f30f7416180 20 remove_watcher() i=3 2020-04-28T12:42:14.490 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.485+0000 7f30f7416180 20 remove_watcher() i=4 2020-04-28T12:42:14.491 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.486+0000 7f30f7416180 20 remove_watcher() i=5 2020-04-28T12:42:14.492 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.488+0000 7f30f7416180 20 remove_watcher() i=6 2020-04-28T12:42:14.493 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.489+0000 7f30f7416180 20 remove_watcher() i=7 2020-04-28T12:42:14.498 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:14.551 INFO:teuthology.orchestra.run.smithi197:> radosgw-admin gc process --include-all 2020-04-28T12:42:14.630 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.625+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.632 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.627+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.632 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.627+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.633 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.628+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.633 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.628+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.633 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.628+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.633 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.628+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.634 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.629+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.647 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.643+0000 7fd2a27aa180 20 RGWRados::pool_iterate: got zonegroup_info.4efd78d7-40b2-4450-ad2b-8f7fd7f14099 2020-04-28T12:42:14.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.643+0000 7fd2a27aa180 20 RGWRados::pool_iterate: got zone_info.e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 2020-04-28T12:42:14.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.643+0000 7fd2a27aa180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:42:14.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.643+0000 7fd2a27aa180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:42:14.648 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.643+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.643+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.643+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.644+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:42:14.649 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.644+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.644+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.644+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.644+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:42:14.650 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.645+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.645+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.645+0000 7fd2a27aa180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:42:14.651 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.645+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.645+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.645+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:42:14.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 20 zonegroup default 2020-04-28T12:42:14.652 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 10 Cannot find current period zone using local zone 2020-04-28T12:42:14.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.646+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.647+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.653 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.647+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.654 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.647+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:42:14.654 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.647+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.654 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.647+0000 7fd2a27aa180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:42:14.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.647+0000 7fd2a27aa180 20 zone default found 2020-04-28T12:42:14.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.647+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.648+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.648+0000 7fd2a27aa180 20 rados->read ofs=0 len=0 2020-04-28T12:42:14.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.648+0000 7fd29079e700 0 -- 172.21.15.197:0/2856753023 >> [v2:172.21.15.197:6826/23556,v1:172.21.15.197:6827/23556] conn(0x563aaacd5fc0 msgr2=0x563aaacd8410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:42:14.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.648+0000 7fd2a27aa180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:42:14.655 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.648+0000 7fd2a27aa180 20 started sync module instance, tier type = 2020-04-28T12:42:14.656 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.648+0000 7fd2a27aa180 20 started zone id=e178e290-c1ed-49b6-b9ff-4b37e8f78ff2 (name=default) with tier type = 2020-04-28T12:42:14.663 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.659+0000 7fd2a27aa180 20 add_watcher() i=0 2020-04-28T12:42:14.664 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.659+0000 7fd2a27aa180 20 add_watcher() i=1 2020-04-28T12:42:14.664 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.659+0000 7fd2a27aa180 20 add_watcher() i=2 2020-04-28T12:42:14.664 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.659+0000 7fd2a27aa180 20 add_watcher() i=3 2020-04-28T12:42:14.664 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.659+0000 7fd2a27aa180 20 add_watcher() i=4 2020-04-28T12:42:14.664 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.659+0000 7fd2a27aa180 20 add_watcher() i=5 2020-04-28T12:42:14.664 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.659+0000 7fd2a27aa180 20 add_watcher() i=6 2020-04-28T12:42:14.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.660+0000 7fd2a27aa180 20 add_watcher() i=7 2020-04-28T12:42:14.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.660+0000 7fd2a27aa180 2 all 8 watchers are set, enabling cache 2020-04-28T12:42:14.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.660+0000 7fd2a27aa180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:42:14.665 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.660+0000 7fd2a27aa180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:42:14.666 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.660+0000 7fd260fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:42:14.666 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.661+0000 7fd28ff9d700 0 -- 172.21.15.197:0/2332839224 >> v2:172.21.15.66:3300/0 conn(0x563aaad12d70 msgr2=0x563aaad131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2020-04-28T12:42:14.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.709+0000 7fd1d2ffd700 20 reqs_thread_entry: start 2020-04-28T12:42:14.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.709+0000 7fd1d0ff9700 20 reqs_thread_entry: start 2020-04-28T12:42:14.714 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.709+0000 7fd2a27aa180 20 init_complete bucket index max shards: 1999 2020-04-28T12:42:14.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.709+0000 7fd1c6ffd700 20 reqs_thread_entry: start 2020-04-28T12:42:14.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.709+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T12:42:14.715 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.711+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.712+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.716 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.712+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.718 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.713+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T12:42:14.719 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.715+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.720 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.716+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.721 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.716+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.722 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.717+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T12:42:14.724 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.719+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.730 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.720+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.730 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.720+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.730 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.721+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T12:42:14.730 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.723+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.724+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.724+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.731 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.726+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T12:42:14.732 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.728+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.733 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.729+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.734 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.729+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.735 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.730+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T12:42:14.737 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.732+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.738 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.734+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.739 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.734+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.740 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.735+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T12:42:14.742 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.737+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.742 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.738+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.743 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.738+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.744 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.740+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T12:42:14.746 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.742+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.747 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.743+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.748 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.743+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.749 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.744+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T12:42:14.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.746+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.751 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.747+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.752 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.747+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.753 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.748+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T12:42:14.754 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.750+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.751+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.756 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.752+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.758 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.753+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T12:42:14.759 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.755+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.760 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.755+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.760 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.756+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.762 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.757+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T12:42:14.763 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.759+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.764 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.759+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.764 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.760+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.766 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.761+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T12:42:14.767 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.763+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.768 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.764+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.769 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.764+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.770 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.765+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T12:42:14.772 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.767+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.768+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.774 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.769+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.775 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.770+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T12:42:14.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.772+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.777 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.773+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.778 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.773+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.779 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.774+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T12:42:14.781 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.776+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.777+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.782 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.778+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.784 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.779+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T12:42:14.785 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.781+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.786 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.781+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.786 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.782+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.787 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.783+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T12:42:14.789 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.785+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.790 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.786+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.791 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.786+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.792 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.787+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T12:42:14.794 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.789+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.795 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.791+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.796 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.791+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.797 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.793+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T12:42:14.799 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.794+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.799 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.795+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.800 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.795+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.801 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.796+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T12:42:14.803 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.798+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.804 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.799+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.804 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.799+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.805 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.801+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T12:42:14.807 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.802+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.808 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.803+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.808 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.803+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.809 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.805+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T12:42:14.811 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.807+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.812 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.807+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.812 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.808+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.813 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.809+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T12:42:14.815 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.811+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.816 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.811+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.816 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.812+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.817 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.813+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T12:42:14.819 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.815+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.820 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.816+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.821 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.816+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.822 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.817+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T12:42:14.824 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.819+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.825 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.820+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.825 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.821+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.826 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.822+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T12:42:14.828 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.824+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.829 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.825+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.830 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.825+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.831 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.827+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T12:42:14.833 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.828+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.833 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.829+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.834 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.829+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.835 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.830+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T12:42:14.836 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.832+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.837 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.833+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.838 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.833+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.839 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.835+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T12:42:14.841 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.837+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.842 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.837+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.842 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.838+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.844 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.839+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T12:42:14.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.841+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.846 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.842+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.847 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.842+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.848 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.843+0000 7fd2a27aa180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T12:42:14.849 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.845+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.850 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.846+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:42:14.851 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.846+0000 7fd2a27aa180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:42:14.852 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.848+0000 7fd260fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:42:14.853 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.849+0000 7fd2a27aa180 20 remove_watcher() i=0 2020-04-28T12:42:14.853 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.849+0000 7fd2a27aa180 2 removed watcher, disabling cache 2020-04-28T12:42:14.854 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.850+0000 7fd2a27aa180 20 remove_watcher() i=1 2020-04-28T12:42:14.856 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.851+0000 7fd2a27aa180 20 remove_watcher() i=2 2020-04-28T12:42:14.857 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.852+0000 7fd2a27aa180 20 remove_watcher() i=3 2020-04-28T12:42:14.858 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.854+0000 7fd2a27aa180 20 remove_watcher() i=4 2020-04-28T12:42:14.859 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.855+0000 7fd2a27aa180 20 remove_watcher() i=5 2020-04-28T12:42:14.860 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.856+0000 7fd2a27aa180 20 remove_watcher() i=6 2020-04-28T12:42:14.861 INFO:teuthology.orchestra.run.smithi197.stderr:2020-04-28T12:42:14.857+0000 7fd2a27aa180 20 remove_watcher() i=7 2020-04-28T12:42:14.866 INFO:teuthology.orchestra.run.smithi197:> true 2020-04-28T12:42:14.919 INFO:teuthology.orchestra.run.smithi197:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2020-04-28T12:42:15.407 INFO:teuthology.orchestra.run.smithi197.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2020-04-28T12:42:19.308 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :clean UP-TO-DATE 2020-04-28T12:42:35.907 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :compileJava 2020-04-28T12:42:35.907 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :processResources 2020-04-28T12:42:35.908 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :classes 2020-04-28T12:42:36.409 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:36.409 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :compileTestJava 2020-04-28T12:42:36.409 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:36.409 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :processTestResources NO-SOURCE 2020-04-28T12:42:36.409 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :testClasses 2020-04-28T12:42:36.409 INFO:teuthology.orchestra.run.smithi197.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2020-04-28T12:42:36.410 INFO:teuthology.orchestra.run.smithi197.stderr:Note: Recompile with -Xlint:deprecation for details. 2020-04-28T12:42:42.408 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:42.408 INFO:teuthology.orchestra.run.smithi197.stdout:> Task :test 2020-04-28T12:42:42.408 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:42.408 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2020-04-28T12:42:43.407 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:43.408 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2020-04-28T12:42:45.807 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:45.807 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2020-04-28T12:42:46.307 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:46.307 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2020-04-28T12:42:48.407 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:48.407 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2020-04-28T12:42:49.507 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:49.507 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2020-04-28T12:42:51.607 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:51.607 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T12:42:51.607 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:51.607 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T12:42:51.707 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:51.707 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2020-04-28T12:42:52.107 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:52.107 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2020-04-28T12:42:54.207 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:54.207 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2020-04-28T12:42:55.707 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:55.707 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2020-04-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2020-04-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2020-04-28T12:43:09.907 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:09.908 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2020-04-28T12:43:10.407 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:10.407 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2020-04-28T12:43:12.507 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:12.507 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2020-04-28T12:43:13.407 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:13.407 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2020-04-28T12:43:17.707 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:17.707 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2020-04-28T12:43:18.707 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:18.707 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2020-04-28T12:43:21.107 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:21.107 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T12:43:21.207 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:21.207 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T12:43:21.307 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:21.307 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2020-04-28T12:43:24.107 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:24.108 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2020-04-28T12:43:26.407 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:26.407 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2020-04-28T12:43:27.407 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:27.407 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2020-04-28T12:43:29.607 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:29.607 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2020-04-28T12:43:30.307 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:30.308 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2020-04-28T12:43:32.607 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:32.607 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2020-04-28T12:43:40.307 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:40.307 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2020-04-28T12:43:42.507 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:42.507 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2020-04-28T12:43:44.607 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:44.607 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2020-04-28T12:43:46.707 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:46.707 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2020-04-28T12:43:48.107 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:48.107 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2020-04-28T12:43:50.507 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:50.507 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2020-04-28T12:43:51.307 INFO:teuthology.orchestra.run.smithi197.stdout: 2020-04-28T12:43:51.307 INFO:teuthology.orchestra.run.smithi197.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2020-04-28T12:44:20.953 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:44:20.947+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T12:44:28.448 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:44:28.440+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T12:44:42.452 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:44:42.447+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T12:45:49.229 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T12:45:49.222+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T12:46:03.100 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:46:03.096+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T12:47:12.513 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T12:47:12.507+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T12:48:39.403 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:48:39.397+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T12:49:13.047 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:49:13.042+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T12:49:59.642 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:49:59.637+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T12:50:48.684 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:50:48.678+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T12:55:10.337 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T12:55:10.331+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T12:56:10.673 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:56:10.669+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T12:56:10.673 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:56:10.669+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T12:56:22.628 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:56:22.623+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T12:56:22.628 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T12:56:22.623+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T12:58:25.763 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T12:58:25.758+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T12:58:31.261 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T12:58:31.255+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:00:46.752 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:00:46.747+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T13:00:46.753 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:00:46.747+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T13:01:59.497 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:01:59.493+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T13:01:59.497 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:01:59.493+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T13:04:02.583 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:04:02.579+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:04:24.795 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T13:04:24.791+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T13:05:28.502 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:05:28.499+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:06:11.020 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T13:06:11.016+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T13:09:22.754 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:09:22.751+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:10:06.436 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T13:10:06.433+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T13:11:08.608 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:11:08.605+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:11:50.142 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:11:50.139+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T13:11:50.143 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:11:50.139+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T13:13:35.102 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:13:35.097+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:18:38.368 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:18:38.361+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T13:18:38.368 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:18:38.361+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T13:19:59.142 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:19:59.140+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:26:10.499 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:26:10.495+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T13:26:51.706 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T13:26:51.704+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T13:27:34.065 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T13:27:34.063+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T13:27:55.844 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:27:55.844+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:28:15.869 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:28:15.866+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:31:52.894 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:31:52.892+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T13:31:52.894 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:31:52.892+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T13:32:09.042 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:32:09.041+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T13:32:37.862 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:32:37.861+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T13:32:37.863 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:32:37.861+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T13:33:25.593 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T13:33:25.592+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T13:34:27.596 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:34:27.595+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T13:34:27.596 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:34:27.595+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T13:35:34.959 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:35:34.954+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:36:20.369 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T13:36:20.368+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T13:41:07.901 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:41:07.899+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:43:20.201 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:43:20.199+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T13:43:52.875 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:43:52.869+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T13:46:37.492 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:46:37.491+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T13:47:48.466 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T13:47:48.464+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T13:49:44.882 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:49:44.879+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T13:49:44.883 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T13:49:44.879+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T13:53:50.408 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T13:53:50.404+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:00:51.632 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T14:00:51.631+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T14:02:12.257 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T14:02:12.254+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T14:06:02.462 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:06:02.455+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T14:06:02.462 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:06:02.455+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T14:06:22.433 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T14:06:22.431+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T14:06:48.260 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T14:06:48.259+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:08:13.320 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T14:08:13.319+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:11:21.954 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T14:11:21.954+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T14:15:57.734 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:15:57.733+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T14:15:57.734 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:15:57.733+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T14:19:47.573 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T14:19:47.571+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T14:20:54.620 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:20:54.620+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T14:20:54.620 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:20:54.620+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T14:22:41.212 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:22:41.211+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T14:22:41.213 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:22:41.211+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T14:23:16.254 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T14:23:16.253+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:29:37.303 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T14:29:37.302+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:34:55.254 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T14:34:55.253+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T14:35:03.272 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T14:35:03.271+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T14:37:33.999 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T14:37:33.997+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T14:39:45.081 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:39:45.080+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T14:39:45.081 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:39:45.080+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T14:40:19.955 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T14:40:19.954+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T14:41:21.834 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T14:41:21.831+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T14:41:58.992 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T14:41:58.991+0000 7fdde0ece700 -1 reset not still connected to 0x55b0bf59d1e0 2020-04-28T14:43:10.045 INFO:tasks.rgw.client.0.smithi197.stdout:2020-04-28T14:43:09.732+0000 7fd5b4d33700 -1 RGWWatcher::handle_error cookie 94438122187776 err (107) Transport endpoint is not connected 2020-04-28T14:43:23.302 INFO:tasks.ceph.osd.6.smithi066.stderr:problem writing to /var/log/ceph/ceph-osd.6.log: (28) No space left on device 2020-04-28T14:43:23.303 INFO:tasks.ceph.osd.4.smithi066.stderr:problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2020-04-28T14:43:23.303 INFO:tasks.ceph.osd.5.smithi066.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2020-04-28T14:43:23.305 INFO:tasks.ceph.osd.7.smithi066.stderr:problem writing to /var/log/ceph/ceph-osd.7.log: (28) No space left on device 2020-04-28T14:43:23.990 INFO:tasks.ceph.mon.b.smithi066.stderr:problem writing to /var/log/ceph/ceph-mon.b.log: (28) No space left on device 2020-04-28T14:43:24.817 INFO:tasks.ceph.mgr.x.smithi066.stderr:problem writing to /var/log/ceph/ceph-mgr.x.log: (28) No space left on device 2020-04-28T14:44:58.145 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:44:58.144+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T14:44:58.146 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:44:58.144+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T14:47:27.004 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T14:47:27.001+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:49:01.961 INFO:tasks.ceph.osd.1.smithi197.stderr:problem writing to /var/log/ceph/ceph-osd.1.log: (28) No space left on device 2020-04-28T14:49:01.961 INFO:tasks.ceph.osd.2.smithi197.stderr:problem writing to /var/log/ceph/ceph-osd.2.log: (28) No space left on device 2020-04-28T14:49:01.962 INFO:tasks.ceph.osd.0.smithi197.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2020-04-28T14:49:01.963 INFO:tasks.ceph.osd.3.smithi197.stderr:problem writing to /var/log/ceph/ceph-osd.3.log: (28) No space left on device 2020-04-28T14:49:02.111 INFO:tasks.ceph.mon.a.smithi197.stderr:problem writing to /var/log/ceph/ceph-mon.a.log: (28) No space left on device 2020-04-28T14:49:02.112 INFO:tasks.ceph.mon.c.smithi197.stderr:problem writing to /var/log/ceph/ceph-mon.c.log: (28) No space left on device 2020-04-28T14:49:02.115 INFO:tasks.ceph.mgr.y.smithi197.stderr:problem writing to /var/log/ceph/ceph-mgr.y.log: (28) No space left on device 2020-04-28T14:49:02.205 INFO:tasks.rgw.client.0.smithi197.stdout:problem writing to /var/log/ceph/rgw.ceph.client.0.log: (28) No space left on device 2020-04-28T14:50:33.752 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T14:50:33.750+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:53:00.309 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:53:00.307+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T14:53:00.309 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:53:00.307+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T14:54:20.139 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T14:54:20.137+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T14:55:41.179 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T14:55:41.175+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T14:56:48.977 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:56:48.976+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T14:56:48.977 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T14:56:48.976+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T14:57:38.430 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:57:38.427+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T14:57:38.430 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:57:38.427+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T14:58:11.025 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:58:11.024+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T14:58:11.026 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T14:58:11.024+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T15:00:57.979 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:00:57.977+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T15:00:57.979 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:00:57.977+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T15:02:59.116 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T15:02:59.113+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T15:03:11.931 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:03:11.927+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T15:03:11.931 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:03:11.927+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T15:03:14.206 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T15:03:14.204+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T15:03:17.926 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T15:03:17.923+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T15:12:00.792 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T15:12:00.790+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T15:12:00.819 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T15:12:00.790+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T15:20:19.349 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T15:20:19.346+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T15:33:40.983 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T15:33:40.982+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T15:34:49.934 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T15:34:49.932+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T15:37:18.159 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:37:18.158+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T15:37:18.160 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:37:18.158+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T15:42:43.863 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:42:43.860+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T15:42:43.863 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:42:43.861+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T15:44:35.310 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T15:44:35.306+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T15:45:46.939 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T15:45:46.937+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T15:46:33.802 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T15:46:33.800+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T15:47:27.837 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T15:47:27.834+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T15:47:53.163 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T15:47:53.160+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T15:49:09.197 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T15:49:09.195+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T15:55:27.527 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:55:27.524+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T15:58:57.143 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:58:57.140+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T15:58:57.143 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T15:58:57.140+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T15:59:40.895 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T15:59:40.893+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T16:02:52.298 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:02:52.296+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:03:52.274 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T16:03:52.271+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T16:05:02.187 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:05:02.185+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:05:15.448 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T16:05:15.445+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T16:08:14.136 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:08:14.133+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T16:08:14.136 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:08:14.133+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T16:10:20.422 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:10:20.420+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:10:36.870 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T16:10:36.867+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T16:13:04.241 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:13:04.239+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:14:52.071 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:14:52.067+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T16:14:52.071 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:14:52.067+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T16:15:58.120 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T16:15:58.117+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T16:19:32.916 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:19:32.912+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:21:00.608 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:21:00.604+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T16:21:00.608 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:21:00.604+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T16:22:18.419 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T16:22:18.415+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T16:22:18.419 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T16:22:18.415+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T16:26:47.442 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T16:26:47.439+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T16:27:44.346 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:27:44.343+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:32:14.237 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:32:14.235+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T16:34:18.583 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:34:18.581+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T16:34:18.584 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:34:18.581+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T16:39:02.544 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:39:02.539+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:40:18.062 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T16:40:18.059+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T16:42:35.424 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T16:42:35.421+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T16:46:12.866 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T16:46:12.861+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T16:51:06.536 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T16:51:06.531+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T16:53:39.063 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T16:53:39.058+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T16:54:39.666 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T16:54:39.662+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T16:55:42.777 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T16:55:42.773+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T16:57:50.682 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T16:57:50.677+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T16:58:49.377 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T16:58:49.374+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T17:06:27.020 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T17:06:27.017+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T17:10:58.413 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T17:10:58.410+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T17:12:00.378 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T17:12:00.375+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T17:24:48.302 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T17:24:48.300+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T17:26:20.957 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T17:26:20.955+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T17:31:00.967 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T17:31:00.961+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T17:39:55.078 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T17:39:55.074+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T17:50:13.574 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T17:50:13.572+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T17:50:18.684 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T17:50:18.682+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T17:51:08.244 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T17:51:08.242+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T17:51:39.149 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T17:51:39.147+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T17:52:19.677 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T17:52:19.675+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T17:54:52.961 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T17:54:52.958+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T17:57:01.995 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T17:57:01.993+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T18:00:18.547 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T18:00:18.537+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T18:00:18.547 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T18:00:18.537+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T18:04:47.035 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T18:04:47.034+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T18:10:10.828 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T18:10:10.826+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T18:10:27.682 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T18:10:27.679+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T18:12:57.091 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T18:12:57.088+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T18:12:57.091 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T18:12:57.088+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T18:16:54.946 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T18:16:54.945+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T18:18:27.305 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T18:18:27.303+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T18:20:13.198 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T18:20:13.196+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T18:21:30.273 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T18:21:30.267+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T18:22:42.282 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T18:22:42.279+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T18:24:55.156 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T18:24:55.151+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T18:31:45.222 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T18:31:45.219+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T18:33:48.770 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T18:33:48.767+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T18:41:21.552 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T18:41:21.549+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T18:41:21.552 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T18:41:21.549+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T18:51:55.539 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T18:51:55.538+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T18:51:55.556 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T18:51:55.538+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T18:54:13.327 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T18:54:13.321+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T18:54:13.327 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T18:54:13.321+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T18:58:08.208 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T18:58:08.206+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T19:01:05.845 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:01:05.842+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T19:01:05.845 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:01:05.842+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T19:09:14.844 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T19:09:14.839+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T19:12:10.591 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:12:10.590+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T19:12:10.593 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:12:10.591+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T19:12:52.809 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T19:12:52.807+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T19:22:59.054 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T19:22:59.052+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T19:23:20.960 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:23:20.958+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T19:23:20.960 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:23:20.958+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T19:25:18.024 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T19:25:18.022+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T19:27:50.655 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T19:27:50.654+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T19:33:02.517 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T19:33:02.514+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T19:34:43.880 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T19:34:43.875+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T19:40:57.559 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:40:57.556+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T19:40:57.574 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:40:57.556+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T19:48:47.051 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T19:48:47.047+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T19:48:47.059 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T19:48:47.047+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T19:49:16.918 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:49:16.916+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T19:49:16.918 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:49:16.917+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T19:51:04.004 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T19:51:04.002+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T19:51:38.014 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T19:51:38.012+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T19:52:26.845 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:52:26.842+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T19:52:26.845 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:52:26.842+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T19:53:30.822 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T19:53:30.820+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T19:54:47.427 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T19:54:47.425+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T20:00:22.785 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T20:00:22.783+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T20:01:05.233 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T20:01:05.230+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T20:01:05.233 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T20:01:05.230+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T20:05:59.241 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T20:05:59.240+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T20:10:21.681 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T20:10:21.677+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T20:10:21.691 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T20:10:21.677+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T20:30:45.703 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T20:30:45.700+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T20:31:14.769 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T20:31:14.766+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T20:31:14.770 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T20:31:14.766+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T20:39:55.659 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T20:39:55.656+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T20:39:55.659 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T20:39:55.656+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T20:42:10.979 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T20:42:10.977+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T20:42:43.403 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T20:42:43.401+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T20:43:08.023 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T20:43:08.017+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T20:43:54.500 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T20:43:54.499+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T20:45:52.983 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T20:45:52.980+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T20:51:19.308 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T20:51:19.305+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T20:56:48.585 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T20:56:48.583+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T21:02:43.511 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:02:43.508+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:02:43.511 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:02:43.508+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:02:50.080 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:02:50.079+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:02:50.081 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:02:50.079+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:06:36.428 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:06:36.424+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:07:04.103 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:07:04.100+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:07:04.103 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:07:04.100+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:07:37.189 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:07:37.185+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:07:37.189 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:07:37.185+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:08:09.243 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:08:09.242+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:11:41.062 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:11:41.060+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:19:36.918 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:19:36.914+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:20:27.597 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:20:27.593+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:20:27.597 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:20:27.593+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:21:15.662 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:21:15.659+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:21:15.662 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:21:15.659+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:22:14.175 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T21:22:14.174+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T21:22:14.176 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T21:22:14.174+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T21:22:41.804 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:22:41.801+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:26:52.690 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:26:52.687+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:26:52.691 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:26:52.687+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:30:50.092 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:30:50.091+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:32:29.332 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T21:32:29.329+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T21:37:12.837 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T21:37:12.836+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T21:38:28.850 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:38:28.846+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:38:28.850 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:38:28.846+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:40:35.890 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:40:35.887+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:43:16.009 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:43:16.006+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:47:18.496 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:47:18.494+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:47:18.496 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:47:18.494+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:52:27.228 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:52:27.224+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T21:52:27.228 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T21:52:27.224+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T21:56:15.967 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:56:15.963+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:58:24.815 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T21:58:24.811+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T21:58:38.549 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T21:58:38.547+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T22:00:13.001 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:00:12.998+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T22:05:37.058 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T22:05:37.047+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T22:05:59.631 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:05:59.629+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T22:07:20.611 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:07:20.601+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T22:07:20.611 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:07:20.601+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T22:09:19.788 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T22:09:19.783+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T22:09:58.839 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T22:09:58.832+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T22:11:27.131 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:11:27.126+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T22:11:27.131 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:11:27.127+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T22:28:05.239 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:28:05.236+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T22:28:05.239 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:28:05.236+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T22:31:05.279 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:31:05.277+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T22:31:05.279 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:31:05.277+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T22:33:11.738 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T22:33:11.736+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T22:35:09.705 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:35:09.702+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T22:35:09.705 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:35:09.702+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T22:43:30.564 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T22:43:30.562+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T22:43:58.797 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:43:58.795+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T22:43:58.798 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:43:58.796+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T22:44:54.532 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:44:54.529+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T22:44:54.532 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:44:54.529+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T22:48:03.567 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:48:03.562+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T22:48:47.859 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:48:47.856+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T22:48:47.859 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T22:48:47.857+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T22:57:36.424 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:57:36.422+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T22:57:36.424 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T22:57:36.422+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T22:57:36.729 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T22:57:36.728+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T23:01:19.786 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T23:01:19.785+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T23:06:46.299 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T23:06:46.297+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T23:07:13.383 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T23:07:13.380+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T23:11:48.711 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T23:11:48.709+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T23:13:12.585 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T23:13:12.582+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T23:16:05.662 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T23:16:05.660+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T23:16:32.144 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T23:16:32.141+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-28T23:17:28.064 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T23:17:28.058+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T23:17:28.064 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T23:17:28.058+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T23:20:08.815 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T23:20:08.809+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T23:26:39.507 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:26:39.505+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T23:26:39.508 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:26:39.505+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T23:28:05.150 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:28:05.147+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T23:28:05.150 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:28:05.147+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T23:28:31.130 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-28T23:28:31.128+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-28T23:29:41.100 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:29:41.098+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T23:29:41.101 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:29:41.098+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T23:31:15.538 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T23:31:15.534+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c680 2020-04-28T23:31:15.539 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T23:31:15.534+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T23:36:01.757 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:36:01.754+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T23:36:24.589 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:36:24.587+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-28T23:36:24.589 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-28T23:36:24.587+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-28T23:38:56.050 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-28T23:38:56.048+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-28T23:42:10.401 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-28T23:42:10.399+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-28T23:56:09.651 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-04-28T23:56:09.648+0000 7fb421ac8700 -1 reset not still connected to 0x55e7e3e3c9c0 2020-04-28T23:58:47.373 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-28T23:58:47.371+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-29T00:00:01.755 INFO:tasks.ceph.osd.4.smithi066.stderr:problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2020-04-29T00:00:58.807 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-29T00:00:58.805+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-29T00:01:01.964 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:01:01.962+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-29T00:01:01.964 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:01:01.962+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-29T00:01:43.226 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:01:43.222+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-29T00:01:43.226 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:01:43.222+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-29T00:06:40.738 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-29T00:06:40.735+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-29T00:16:58.477 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-04-29T00:16:58.474+0000 7f1467188700 -1 reset not still connected to 0x5592110f0c30 2020-04-29T00:17:54.586 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-29T00:17:54.584+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-29T00:20:15.816 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-04-29T00:20:15.815+0000 7fbe23ad5700 -1 reset not still connected to 0x5621c6c97380 2020-04-29T00:21:50.649 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:21:50.647+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-29T00:21:50.651 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:21:50.647+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-29T00:22:29.109 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-04-29T00:22:29.107+0000 7f406bdb5700 -1 reset not still connected to 0x557625ed4680 2020-04-29T00:23:06.916 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:23:06.899+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239e25e10 2020-04-29T00:23:06.916 INFO:tasks.ceph.osd.3.smithi197.stderr:2020-04-29T00:23:06.899+0000 7fc3ecbc5700 -1 reset not still connected to 0x562239f36b60 2020-04-29T00:23:36.823 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-04-29T00:23:36.818+0000 7fdde0ece700 -1 reset not still connected to 0x55b0c1372f70 2020-04-29T00:24:46.676 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-29T00:24:46.676 DEBUG:teuthology.task.console_log:Killing console logger for smithi197 2020-04-29T00:24:46.677 DEBUG:teuthology.task.console_log:Killing console logger for smithi066 2020-04-29T00:24:46.677 DEBUG:teuthology.task.console_log:Killing console logger for smithi197 2020-04-29T00:24:46.677 DEBUG:teuthology.task.console_log:Killing console logger for smithi066 2020-04-29T00:24:46.678 DEBUG:teuthology.exit:Finished running handlers