2020-04-28T12:37:09.196 INFO:root:teuthology version: 1.0.0-8b924f7 2020-04-28T12:37:09.197 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.wezjc3to.tmp -- --verbose --lock --description rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} --name teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi --block --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990027 2020-04-28T12:37:09.242 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:37:09.299 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990027 branch: octopus description: rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml} email: ceph-qa@ceph.io first_in_suite: false job_id: '4990027' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: '8.1' overrides: admin_socket: branch: octopus ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 rgw max chunk size: 4194304 rgw obj stripe size: 6291456 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1999 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true rgw.client.1: ca: root client: client.1 embed-key: true root: client: client.0 cn: teuthology install: - client.0 - client.1 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 client.1: ssl certificate: rgw.client.1 compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 sleep_before_teardown: 0 suite: rgw suite_branch: octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph_octopus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 tasks: - install: null - ceph: null - openssl_keys: null - rgw: client.0: null - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_rgw_throttle.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 teuthology_branch: py2 tube: smithi verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.22126 2020-04-28T12:37:09.299 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_octopus/qa; will attempt to use it 2020-04-28T12:37:09.299 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks 2020-04-28T12:37:09.300 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-28T12:37:09.301 INFO:teuthology.task.internal:Checking packages... 2020-04-28T12:37:09.333 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'a8c125c7d78f5cd973863993d258cd717ade4c99' 2020-04-28T12:37:09.334 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-28T12:37:09.334 INFO:teuthology.packaging:ref: None 2020-04-28T12:37:09.334 INFO:teuthology.packaging:tag: None 2020-04-28T12:37:09.334 INFO:teuthology.packaging:branch: octopus 2020-04-28T12:37:09.334 INFO:teuthology.packaging:sha1: a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:37:09.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2020-04-28T12:37:09.756 INFO:teuthology.task.internal:Found packages for ceph version 15.2.1-150.gfcb0536 2020-04-28T12:37:09.756 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-28T12:37:09.767 INFO:teuthology.task.internal:no buildpackages task found 2020-04-28T12:37:09.767 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-28T12:37:09.810 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-28T12:37:09.810 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:37:09.863 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_teuthology@teuthology', 'description': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990027', 'machine_type': 'smithi'} 2020-04-28T12:37:09.878 DEBUG:teuthology.lock.ops:locked ubuntu@smithi026.front.sepia.ceph.com, ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:37:09.934 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:37:10.110 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.1 2020-04-28T12:37:10.114 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.1 2020-04-28T12:37:10.550 INFO:teuthology.orchestra.console:Power off smithi107 2020-04-28T12:37:10.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:37:10.567 INFO:teuthology.orchestra.console:Power off smithi026 2020-04-28T12:37:10.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-28T12:37:10.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:10.590 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:10.699 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2020-04-28T12:37:10.710 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2020-04-28T12:37:10.801 INFO:teuthology.orchestra.console:Power on smithi107 2020-04-28T12:37:10.801 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:37:10.811 INFO:teuthology.orchestra.console:Power on smithi026 2020-04-28T12:37:10.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-28T12:37:10.820 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:10.830 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:14.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:14.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:18.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:18.965 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-28T12:37:19.167 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2020-04-28T12:37:19.175 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2020-04-28T12:37:19.269 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2020-04-28T12:37:19.276 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2020-04-28T12:40:05.677 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:40:14.739 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:40:23.830 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:40:32.919 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:40:42.007 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:40:50.972 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:40:51.092 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:00.055 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:00.145 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:09.143 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:09.203 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:18.231 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:18.256 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:27.315 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:27.316 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:36.375 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:41:45.459 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:42:33.359 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:42:33.701 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:34.004 INFO:teuthology.orchestra.run.smithi107:> hostname 2020-04-28T12:42:34.018 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2020-04-28T12:42:34.019 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:34.072 INFO:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2020-04-28T12:42:34.127 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2020-04-28T12:42:34.128 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:34.181 INFO:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2020-04-28T12:42:34.291 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:34.305 INFO:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2020-04-28T12:42:34.375 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:34.428 INFO:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2020-04-28T12:42:34.495 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:34.548 INFO:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2020-04-28T12:42:34.614 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:34.668 INFO:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2020-04-28T12:42:34.734 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2020-04-28T12:42:34.735 DEBUG:teuthology.parallel:result is None 2020-04-28T12:42:51.472 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:42:51.715 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:52.038 INFO:teuthology.orchestra.run.smithi026:> hostname 2020-04-28T12:42:52.053 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2020-04-28T12:42:52.054 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:52.108 INFO:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2020-04-28T12:42:52.163 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2020-04-28T12:42:52.164 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:52.222 INFO:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2020-04-28T12:42:52.347 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:52.362 INFO:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2020-04-28T12:42:52.438 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:52.493 INFO:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2020-04-28T12:42:52.565 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:52.619 INFO:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2020-04-28T12:42:52.691 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:52.745 INFO:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2020-04-28T12:42:52.818 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2020-04-28T12:42:52.823 DEBUG:teuthology.parallel:result is None 2020-04-28T12:42:52.944 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2020-04-28T12:42:52.945 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:42:52.960 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2020-04-28T12:42:52.960 INFO:teuthology.lock.ops:New key found. Updating... 2020-04-28T12:42:52.982 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:42:52.983 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:42:53.094 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:53.272 INFO:teuthology.orchestra.run.smithi026:> uname -m 2020-04-28T12:42:53.334 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2020-04-28T12:42:53.334 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:53.388 INFO:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2020-04-28T12:42:53.443 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Linux" 2020-04-28T12:42:53.443 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8 (Core)" 2020-04-28T12:42:53.443 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2020-04-28T12:42:53.443 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:42:53.443 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2020-04-28T12:42:53.444 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:42:53.444 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:42:53.444 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2020-04-28T12:42:53.444 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:42:53.444 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:42:53.444 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:42:53.444 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:42:53.445 INFO:teuthology.orchestra.run.smithi026.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:42:53.445 INFO:teuthology.orchestra.run.smithi026.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:42:53.445 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:42:53.445 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:42:53.445 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:42:53.446 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2020-04-28T12:42:53.464 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2020-04-28T12:42:53.464 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:42:53.557 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:53.725 INFO:teuthology.orchestra.run.smithi107:> uname -m 2020-04-28T12:42:53.780 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2020-04-28T12:42:53.780 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:53.837 INFO:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2020-04-28T12:42:53.891 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Linux" 2020-04-28T12:42:53.891 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8 (Core)" 2020-04-28T12:42:53.892 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2020-04-28T12:42:53.892 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:42:53.892 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2020-04-28T12:42:53.892 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:42:53.892 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:42:53.892 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2020-04-28T12:42:53.893 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:42:53.893 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:42:53.893 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:42:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:42:53.893 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:42:53.894 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:42:53.894 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:42:53.894 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:42:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:42:53.895 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2020-04-28T12:42:53.909 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-04-28T12:42:53.941 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi026.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtIFPOLrhvQWoDT8OfhzGSwQwKQbNsaQV7bgUylZj1TolbBM5+RgV0r4kvRjlTnMrkEr1FHsfi3BjB4urE0eBiWASiQIFrawLLgyyzEUazX5fv2lDNMVWsDA3U3008kjWoDXDnaS+3nxXsMg8y6ljpq0iByKeMsReZlXDcr2hwmwd+yG58Sfu8FWd4Gjd2n4Wkl7Q4FS4FUWxNjRETkgErzeUGBhkPFGj77/SAzoEOKuqkGjqXjIuHYLQ2Fw5/bc+q1LR20kIh51GYI8pRThKOv4UFqkZFTrhTsA0pfc0HPYJr/bQc5zIFxpmLnVIizQgI5PthHzZUSnYUNrZUogyAuyNMUUJ0GFaNeZXDKk9BOM25wL5LdGHfxEaQgFfyBFfZ12cWzugAkBXqjNyxusIHaa39Cf/gTQ27BH2AzgpMBs6eNRxPnvOQKKbgtxBhZ625qGBSwt5LDlCKZYg560t5pucPejyDrdvYSZTdA7u+ypIIWDWUR/WLD7KoDJHJaBs= smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9P0wjo/erkimMEJ+rTtKsfh7avWGKVURM5ANfgCWU9QIytCE806FICjvXd3haR6NlCNYmMxcTsBjTnBk5pjtigoMm0DloZsxB7FBmun8XBYGC4DaCujIfqfFC732bCNl9vdV7h7RxkYBz3RCPVOtOUeigcsIeXF3ASn1CTF6Lyf+Hjvy3xY8L/2GC4qV9nXF47Nl3JkHyiP+mRrXiklHMt+SMaZC+X/nEubDonM+YeHTux31rrIjc1L80J/DsgKE3hJKqD5kcGl8FJ6zaBL5keln9RJjOSat7a0CmuAKsdCNoxQsiHm7zrrgRdcCIK4WGwm7AiBwhwErOoJiD6NxUkLeTgmrfw6SGwU3cfIPPT2tRz2HKMQFlykSbOAdJKC9ca/PE6Pfk5CDyYOLNqsccAFAlVVby8lY+iuSEC5/VPDd4eLXWUel2GLD/dbM7i7p7NjCYVbDW6anM1leNPvQYp3qwUqrMK4JFWTZP08fcesoktSHZv5a1FdKrulXHD4s= 2020-04-28T12:42:53.941 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-28T12:42:53.988 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-04-28T12:42:53.998 INFO:teuthology.task.internal:Saving configuration 2020-04-28T12:42:54.021 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-04-28T12:42:54.030 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-04-28T12:42:54.047 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:37:09.867728', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi026.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNh6+5vJ4t4Sh5qLuF//wXbm3fB1gRjtjQmsSh8QxeXbmME1X+1dgJONb6OYiH4Prn7WIt6l/sJ7H1CIeicddzI=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990027'} 2020-04-28T12:42:54.062 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-04-28 12:37:09.867705', u'locked_by': u'scheduled_teuthology@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi107.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBukr6d0pQh21MSw6jRulkmlIDcWPuKFkfdi7ECLBaJRPwC7vBIA3LIpr8/W/1saWuOoyzBohl29jUuH9iSipfE=', u'description': u'/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990027'} 2020-04-28T12:42:54.062 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-04-28T12:42:54.072 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T12:42:54.072 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T12:42:54.073 INFO:teuthology.run_tasks:Running task console_log... 2020-04-28T12:42:54.145 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-04-28T12:42:54.146 INFO:teuthology.run_tasks:Running task internal.connect... 2020-04-28T12:42:54.157 INFO:teuthology.task.internal:Opening connections... 2020-04-28T12:42:54.157 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2020-04-28T12:42:54.158 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:42:54.238 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:42:54.239 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:42:54.309 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-04-28T12:42:54.323 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:54.378 INFO:teuthology.orchestra.run.smithi026:> uname -m 2020-04-28T12:42:54.433 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2020-04-28T12:42:54.433 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:54.487 INFO:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2020-04-28T12:42:54.541 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Linux" 2020-04-28T12:42:54.542 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8 (Core)" 2020-04-28T12:42:54.542 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2020-04-28T12:42:54.542 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:42:54.542 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2020-04-28T12:42:54.542 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:42:54.542 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:42:54.543 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2020-04-28T12:42:54.543 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:42:54.543 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:42:54.543 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:42:54.543 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:42:54.543 INFO:teuthology.orchestra.run.smithi026.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:42:54.543 INFO:teuthology.orchestra.run.smithi026.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:42:54.544 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:42:54.544 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:42:54.544 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:42:54.544 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2020-04-28T12:42:54.564 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:54.578 INFO:teuthology.orchestra.run.smithi107:> uname -m 2020-04-28T12:42:54.639 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2020-04-28T12:42:54.639 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:54.691 INFO:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2020-04-28T12:42:54.745 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Linux" 2020-04-28T12:42:54.745 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8 (Core)" 2020-04-28T12:42:54.745 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2020-04-28T12:42:54.745 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2020-04-28T12:42:54.746 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2020-04-28T12:42:54.746 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2020-04-28T12:42:54.746 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-04-28T12:42:54.746 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2020-04-28T12:42:54.746 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-04-28T12:42:54.746 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.centos.org/" 2020-04-28T12:42:54.746 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-04-28T12:42:54.747 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:42:54.747 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-04-28T12:42:54.747 INFO:teuthology.orchestra.run.smithi107.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-04-28T12:42:54.747 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-04-28T12:42:54.747 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-04-28T12:42:54.747 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:42:54.748 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2020-04-28T12:42:54.771 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-04-28T12:42:54.789 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-04-28T12:42:54.799 INFO:teuthology.task.internal:Checking for old test directory... 2020-04-28T12:42:54.799 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:54.814 INFO:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:54.871 INFO:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2020-04-28T12:42:54.924 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-04-28T12:42:54.934 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-04-28T12:42:54.935 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:54.951 INFO:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:42:54.994 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:42:55.007 INFO:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2020-04-28T12:42:55.066 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-04-28T12:42:55.126 INFO:teuthology.run_tasks:Running task kernel... 2020-04-28T12:42:55.188 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'node-exporter.b': {'sha1': 'distro', 'kdb': True}, 'node-exporter.a': {'sha1': 'distro', 'kdb': True}, 'prometheus.a': {'sha1': 'distro', 'kdb': True}} 2020-04-28T12:42:55.188 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-04-28T12:42:55.189 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:55.206 INFO:teuthology.orchestra.run.smithi026:> uname -r 2020-04-28T12:42:55.263 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:42:55.263 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:42:55.263 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:42:55.320 INFO:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2020-04-28T12:42:58.013 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - AppStream 40 MB/s | 7.0 MB 00:00 2020-04-28T12:42:59.290 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-04-28T12:42:59.727 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-04-28T12:42:59.882 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for ceph-el8 owned by ktdreyer 438 kB/s | 47 kB 00:00 2020-04-28T12:43:00.706 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 6.4 MB 00:00 2020-04-28T12:43:02.086 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 3.8 MB/s | 20 kB 00:00 2020-04-28T12:43:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-28T12:43:03.088 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:43:03.232 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:43:03.233 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:43:03.233 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:43:03.347 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:03.362 INFO:teuthology.orchestra.run.smithi026:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:43:03.821 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:01 ago on Tue 28 Apr 2020 12:43:02 PM UTC. 2020-04-28T12:43:04.186 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:43:04.187 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:43:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2020-04-28T12:43:04.187 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:43:04.187 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalling: 2020-04-28T12:43:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:43:04.187 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:43:04.187 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:43:04.188 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:43:04.188 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:43:04.188 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.5 M 2020-04-28T12:43:04.189 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 0 2020-04-28T12:43:04.189 INFO:teuthology.orchestra.run.smithi026.stderr:Operation aborted. 2020-04-28T12:43:04.260 INFO:teuthology.orchestra.run.smithi026.stdout:Is this ok [y/N]: 2020-04-28T12:43:04.260 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:04.274 INFO:teuthology.orchestra.run.smithi026:> sudo yum reinstall -y kernel || true 2020-04-28T12:43:04.737 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:43:02 PM UTC. 2020-04-28T12:43:05.102 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:43:05.102 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:43:05.103 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2020-04-28T12:43:05.103 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:43:05.103 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalling: 2020-04-28T12:43:05.103 INFO:teuthology.orchestra.run.smithi026.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:43:05.103 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:43:05.103 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:43:05.103 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:43:05.104 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:43:05.104 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.5 M 2020-04-28T12:43:05.104 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 0 2020-04-28T12:43:05.104 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:43:05.154 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 31 MB/s | 1.5 MB 00:00 2020-04-28T12:43:05.155 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:43:05.155 INFO:teuthology.orchestra.run.smithi026.stdout:Total 30 MB/s | 1.5 MB 00:00 2020-04-28T12:43:05.177 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:43:05.343 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:43:05.343 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:43:05.388 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:43:05.389 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:43:05.503 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:43:05.668 INFO:teuthology.orchestra.run.smithi026.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:43:05.668 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:43:05.893 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:43:05.893 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi026.stdout:Reinstalled: 2020-04-28T12:43:06.465 INFO:teuthology.orchestra.run.smithi026.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:43:06.465 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:43:06.465 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:43:06.578 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:06.593 INFO:teuthology.orchestra.run.smithi026:> rpm -q kernel --last | head -n 1 2020-04-28T12:43:06.701 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:43:05 PM UTC 2020-04-28T12:43:06.702 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:43:06.702 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:43:06.702 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:06.718 INFO:teuthology.orchestra.run.smithi107:> uname -r 2020-04-28T12:43:06.774 INFO:teuthology.orchestra.run.smithi107.stdout:4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:43:06.775 INFO:teuthology.task.kernel:Running kernel on smithi107: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:43:06.775 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:06.830 INFO:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2020-04-28T12:43:09.545 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-8 - AppStream 42 MB/s | 7.0 MB 00:00 2020-04-28T12:43:10.721 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-8 - Base 26 MB/s | 2.2 MB 00:00 2020-04-28T12:43:11.143 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-04-28T12:43:11.281 INFO:teuthology.orchestra.run.smithi107.stdout:Copr repo for ceph-el8 owned by ktdreyer 500 kB/s | 47 kB 00:00 2020-04-28T12:43:11.569 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 27 MB/s | 6.4 MB 00:00 2020-04-28T12:43:12.866 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 3.8 MB/s | 20 kB 00:00 2020-04-28T12:43:13.737 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-04-28T12:43:13.737 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-4.18.0-147.8.1.el8_1.x86_64 is already installed. 2020-04-28T12:43:13.881 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:43:13.882 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:43:13.882 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:43:14.002 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:14.015 INFO:teuthology.orchestra.run.smithi107:> echo no | sudo yum reinstall kernel || true 2020-04-28T12:43:14.444 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:02 ago on Tue 28 Apr 2020 12:43:12 PM UTC. 2020-04-28T12:43:14.776 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:43:14.777 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:43:14.777 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2020-04-28T12:43:14.778 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:43:14.778 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalling: 2020-04-28T12:43:14.778 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:43:14.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:43:14.778 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:43:14.778 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:43:14.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:43:14.779 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 1.5 M 2020-04-28T12:43:14.779 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 0 2020-04-28T12:43:14.779 INFO:teuthology.orchestra.run.smithi107.stderr:Operation aborted. 2020-04-28T12:43:14.868 INFO:teuthology.orchestra.run.smithi107.stdout:Is this ok [y/N]: 2020-04-28T12:43:14.868 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:14.881 INFO:teuthology.orchestra.run.smithi107:> sudo yum reinstall -y kernel || true 2020-04-28T12:43:15.308 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:43:12 PM UTC. 2020-04-28T12:43:15.642 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:43:15.643 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:43:15.643 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2020-04-28T12:43:15.643 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:43:15.644 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalling: 2020-04-28T12:43:15.644 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 4.18.0-147.8.1.el8_1 CentOS-Base 1.5 M 2020-04-28T12:43:15.644 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:43:15.644 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:43:15.644 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:43:15.644 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:43:15.644 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 1.5 M 2020-04-28T12:43:15.645 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 0 2020-04-28T12:43:15.645 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:43:15.692 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64.rpm 32 MB/s | 1.5 MB 00:00 2020-04-28T12:43:15.692 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:43:15.693 INFO:teuthology.orchestra.run.smithi107.stdout:Total 32 MB/s | 1.5 MB 00:00 2020-04-28T12:43:15.710 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:43:15.858 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:43:15.859 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:43:15.903 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:43:15.903 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:43:15.996 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:43:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: Reinstalling : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:43:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:43:16.406 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:43:16.407 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 1/2 2020-04-28T12:43:16.737 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-4.18.0-147.8.1.el8_1.x86_64 2/2 2020-04-28T12:43:16.737 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:43:16.738 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalled: 2020-04-28T12:43:16.738 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:43:16.738 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:43:16.738 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:43:16.827 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:16.844 INFO:teuthology.orchestra.run.smithi107:> rpm -q kernel --last | head -n 1 2020-04-28T12:43:16.942 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-4.18.0-147.8.1.el8_1.x86_64 Tue 28 Apr 2020 12:43:15 PM UTC 2020-04-28T12:43:16.943 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.8.1.el8_1.x86_64 2020-04-28T12:43:16.943 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-04-28T12:43:16.943 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-04-28T12:43:16.943 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:16.961 INFO:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:43:17.041 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2020-04-28T12:43:17.057 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-04-28T12:43:17.058 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:17.071 INFO:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-04-28T12:43:17.172 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2020-04-28T12:43:17.184 INFO:teuthology.run_tasks:Running task internal.base... 2020-04-28T12:43:17.192 INFO:teuthology.task.internal:Creating test directory... 2020-04-28T12:43:17.192 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:17.209 INFO:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:43:17.252 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:17.266 INFO:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-04-28T12:43:17.324 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-04-28T12:43:17.334 INFO:teuthology.run_tasks:Running task internal.archive... 2020-04-28T12:43:17.351 INFO:teuthology.task.internal:Creating archive directory... 2020-04-28T12:43:17.352 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:17.368 INFO:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:43:17.411 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:17.424 INFO:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-04-28T12:43:17.498 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-04-28T12:43:17.522 INFO:teuthology.task.internal:Enabling coredump saving... 2020-04-28T12:43:17.522 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:17.539 INFO:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:43:17.582 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:17.595 INFO:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-04-28T12:43:17.617 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:43:17.636 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:43:17.673 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:43:17.687 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-04-28T12:43:17.688 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-04-28T12:43:17.696 INFO:teuthology.task.internal:Configuring sudo... 2020-04-28T12:43:17.696 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:17.712 INFO:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:43:17.755 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:17.768 INFO:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-04-28T12:43:17.837 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-04-28T12:43:17.852 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-04-28T12:43:17.852 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:17.868 INFO:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:43:17.911 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:17.926 INFO:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-04-28T12:43:17.996 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:18.015 INFO:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:43:18.116 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:18.163 INFO:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:43:18.246 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:18.307 INFO:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:43:18.382 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:18.422 INFO:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:43:18.499 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:18.554 INFO:teuthology.orchestra.run.smithi026:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:43:18.640 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:18.654 INFO:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:43:18.728 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:18.767 INFO:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-04-28T12:43:18.848 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:18.903 INFO:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:43:18.974 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:19.022 INFO:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-04-28T12:43:19.090 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:19.144 INFO:teuthology.orchestra.run.smithi107:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-04-28T12:43:19.229 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:19.246 INFO:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2020-04-28T12:43:19.290 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:19.303 INFO:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2020-04-28T12:43:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:43:19.447 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-04-28T12:43:19.874 INFO:teuthology.run_tasks:Running task internal.timer... 2020-04-28T12:43:19.885 INFO:teuthology.task.internal:Starting timer... 2020-04-28T12:43:19.885 INFO:teuthology.run_tasks:Running task pcp... 2020-04-28T12:43:19.916 INFO:teuthology.run_tasks:Running task selinux... 2020-04-28T12:43:19.929 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-04-28T12:43:19.929 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:19.947 INFO:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2020-04-28T12:43:20.043 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: [ OK ] 2020-04-28T12:43:20.044 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:20.059 INFO:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2020-04-28T12:43:20.172 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: [ OK ] 2020-04-28T12:43:20.173 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-04-28T12:43:20.173 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:20.187 INFO:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2020-04-28T12:43:20.252 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2020-04-28T12:43:20.253 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:20.266 INFO:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2020-04-28T12:43:20.330 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2020-04-28T12:43:20.331 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': u'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': u'permissive'} 2020-04-28T12:43:20.331 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:20.345 INFO:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:43:20.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:43:20.418 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:20.430 INFO:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-04-28T12:43:20.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:43:20.499 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-04-28T12:43:20.499 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:43:20.513 INFO:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:43:20.587 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:43:20.600 INFO:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2020-04-28T12:43:20.676 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-04-28T12:43:20.692 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2020-04-28T12:43:20.701 INFO:teuthology.repo_utils:Fetching master from origin 2020-04-28T12:43:20.746 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-04-28T12:43:20.762 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-04-28T12:43:20.765 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-04-28T12:43:21.112 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-04-28T12:43:22.185 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-04-28T12:43:25.175 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-04-28T12:43:25.198 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:25 +0000 (0:00:00.063) 0:00:00.063 ********* 2020-04-28T12:43:25.209 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:25 +0000 (0:00:00.011) 0:00:00.074 ********* 2020-04-28T12:43:26.661 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi107.front.sepia.ceph.com] 2020-04-28T12:43:26.738 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:26 +0000 (0:00:01.529) 0:00:01.604 ********* 2020-04-28T12:43:27.080 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-28T12:43:27.081 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:43:27.116 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:27 +0000 (0:00:00.377) 0:00:01.981 ********* 2020-04-28T12:43:27.724 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi107.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:43:27.774 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:27 +0000 (0:00:00.653) 0:00:02.635 ********* 2020-04-28T12:43:27.779 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-04-28T12:43:27.780 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] 2020-04-28T12:43:27.822 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-28T12:43:27.822 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:27.861 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:27 +0000 (0:00:00.091) 0:00:02.726 ********* 2020-04-28T12:43:27.892 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:27 +0000 (0:00:00.031) 0:00:02.757 ********* 2020-04-28T12:43:28.069 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-04-28T12:43:28.071 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:43:28.111 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:28 +0000 (0:00:00.219) 0:00:02.977 ********* 2020-04-28T12:43:28.214 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-28T12:43:28.216 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:43:28.253 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:28 +0000 (0:00:00.141) 0:00:03.118 ********* 2020-04-28T12:43:28.367 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-04-28T12:43:28.367 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-04-28T12:43:28.405 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:28 +0000 (0:00:00.151) 0:00:03.270 ********* 2020-04-28T12:43:28.431 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-04-28T12:43:28.433 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:28.468 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:28 +0000 (0:00:00.062) 0:00:03.333 ********* 2020-04-28T12:43:28.660 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-04-28T12:43:28.661 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:43:28.697 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:28 +0000 (0:00:00.229) 0:00:03.562 ********* 2020-04-28T12:43:29.226 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077808.27-193703227141170/source", "state": "file", "uid": 0} 2020-04-28T12:43:29.265 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:29 +0000 (0:00:00.568) 0:00:04.131 ********* 2020-04-28T12:43:29.313 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077808.71-253457259339612/source", "state": "file", "uid": 0} 2020-04-28T12:43:29.362 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:29 +0000 (0:00:00.092) 0:00:04.223 ********* 2020-04-28T12:43:29.996 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-04-28T12:43:29.997 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-28T12:43:29.998 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-28T12:43:30.038 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-04-28T12:43:30.039 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-04-28T12:43:30.165 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-04-28T12:43:30.173 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-04-28T12:43:30.380 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:30 +0000 (0:00:01.022) 0:00:05.245 ********* 2020-04-28T12:43:30.438 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:30 +0000 (0:00:00.052) 0:00:05.298 ********* 2020-04-28T12:43:31.053 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi026.front.sepia.ceph.com] 2020-04-28T12:43:31.104 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] 2020-04-28T12:43:31.106 INFO:teuthology.task.ansible.out: 2020-04-28T12:43:31.151 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. 2020-04-28T12:43:31.151 INFO:teuthology.task.ansible.out: This task will still be executed for every host in the inventory list. 2020-04-28T12:43:31.152 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:31 +0000 (0:00:00.718) 0:00:06.017 ********* 2020-04-28T12:43:31.227 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:31 +0000 (0:00:00.074) 0:00:06.092 ********* 2020-04-28T12:43:31.729 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-04-28T12:43:31.731 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.164931", "end": "2020-04-28 12:43:31.710072", "rc": 0, "start": "2020-04-28 12:43:31.545141", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} changed: [smithi107.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.164976", "end": "2020-04-28 12:43:31.710525", "rc": 0, "start": "2020-04-28 12:43:31.545549", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:43:31.769 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:31 +0000 (0:00:00.542) 0:00:06.634 ********* 2020-04-28T12:43:31.815 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:31 +0000 (0:00:00.046) 0:00:06.680 ********* 2020-04-28T12:43:31.986 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-04-28T12:43:31.987 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007010", "end": "2020-04-28 12:43:31.964437", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:43:31.957427", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:43:32.025 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.209) 0:00:06.890 ********* 2020-04-28T12:43:32.042 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.027475", "end": "2020-04-28 12:43:32.020592", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:43:31.993117", "stderr": "", "stderr_lines": [], "stdout": "6c6e94be874b2e32f2708dec8d44a0e25f99b226", "stdout_lines": ["6c6e94be874b2e32f2708dec8d44a0e25f99b226"]} 2020-04-28T12:43:32.079 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.053) 0:00:06.944 ********* 2020-04-28T12:43:32.083 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-04-28T12:43:32.084 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:43:32.122 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.043) 0:00:06.987 ********* 2020-04-28T12:43:32.134 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-04-28T12:43:32.166 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.043) 0:00:07.031 ********* 2020-04-28T12:43:32.171 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-04-28T12:43:32.171 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.209 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.043) 0:00:07.074 ********* 2020-04-28T12:43:32.216 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.253 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.043) 0:00:07.118 ********* 2020-04-28T12:43:32.258 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-04-28T12:43:32.259 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.298 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.043) 0:00:07.161 ********* 2020-04-28T12:43:32.302 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.339 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.042) 0:00:07.204 ********* 2020-04-28T12:43:32.349 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.381 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.041) 0:00:07.246 ********* 2020-04-28T12:43:32.386 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.423 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.041) 0:00:07.288 ********* 2020-04-28T12:43:32.427 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-04-28T12:43:32.430 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.466 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.043) 0:00:07.331 ********* 2020-04-28T12:43:32.472 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.510 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.043) 0:00:07.375 ********* 2020-04-28T12:43:32.514 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-04-28T12:43:32.515 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.555 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.045) 0:00:07.420 ********* 2020-04-28T12:43:32.560 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.599 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:32 +0000 (0:00:00.044) 0:00:07.464 ********* 2020-04-28T12:43:32.606 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.610 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.619 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.630 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.631 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.643 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.644 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.659 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.659 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.661 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.662 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.664 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.674 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.675 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.676 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.687 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.688 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.689 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.700 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.701 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.702 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9', u'name': u'jcaratzas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.702 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.713 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.714 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.715 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.727 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.727 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.729 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw e 2020-04-28T12:43:32.730 INFO:teuthology.task.ansible.out:addd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Co 2020-04-28T12:43:32.735 INFO:teuthology.task.ansible.out:nditional result was False"} 2020-04-28T12:43:32.741 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.742 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.744 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.745 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.756 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.758 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed', u'name': u'cmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.768 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.769 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.770 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.772 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.783 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.784 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.785 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.787 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.797 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.798 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.799 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.800 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.811 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.811 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.813 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.824 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.824 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.825 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.827 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.838 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.839 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.840 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.862 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.862 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.863 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.864 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.865 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.866 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.868 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.869 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.870 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.872 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.883 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.883 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.885 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.887 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.896 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.897 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.899 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.899 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.910 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.911 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.912 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.923 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.924 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.926 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.926 INFO:teuthology.task.ansible.out: 2020-04-28T12:43:32.927 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.928 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.939 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.940 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.942 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.942 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.953 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.955 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.956 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.956 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.958 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.969 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.970 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.971 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.973 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.983 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.984 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.985 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.996 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.997 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:32.998 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.009 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.011 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.011 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.012 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.023 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.024 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.025 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.035 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.036 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.037 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.047 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.048 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.049 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.060 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.060 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.062 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.062 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.064 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.074 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.074 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.076 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.086 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.088 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.099 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.099 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.101 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.101 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.102 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.113 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.113 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.115 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.125 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.125 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.127 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.137 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.138 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.140 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.281 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.294 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.305 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.307 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon BgvhtHMrCcelT98ekPDMoA 6fa3cf08186b93b966b68841f3507a0809d348c5097b39b6140832cac2afd511"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.320 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.332 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.334 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.350 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.357 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.359 INFO:teuthology.task.ansible.out: skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.360 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.371 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.372 INFO:teuthology.task.ansible.out: skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.374 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.375 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.385 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.387 INFO:teuthology.task.ansible.out: skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.388 INFO:teuthology.task.ansible.out: skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.399 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.399 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.401 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.412 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.412 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.414 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.424 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.427 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.438 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.439 INFO:teuthology.task.ansible.out: skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.441 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 vosB15bA3uALkBrmjcKFUg 4ef5cb132c30563fd5fb9e4e9352786ad0d2258e41ed63f91c1f65f69b54d50d"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.443 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.474 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.475 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.475 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.477 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034', u'name': u'khiremat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0', u'name': u'kapandya'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad Uw1JHj0kPIqSd9iOJ68TNg 46badc3b5cd150bfb74daf4300c8329491000521738ba70455631aa4a47e42c0"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.478 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89', u'name': u'prasad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.513 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.913) 0:00:08.378 ********* 2020-04-28T12:43:33.518 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'ovpn': u'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f', u'name': u'vikhyat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.543 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:43:33.583 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.069) 0:00:08.447 ********* 2020-04-28T12:43:33.616 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.034) 0:00:08.482 ********* 2020-04-28T12:43:33.620 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-28T12:43:33.621 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.675 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.058) 0:00:08.540 ********* 2020-04-28T12:43:33.680 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-04-28T12:43:33.722 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.047) 0:00:08.588 ********* 2020-04-28T12:43:33.728 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-28T12:43:33.729 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.765 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.043) 0:00:08.631 ********* 2020-04-28T12:43:33.771 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-04-28T12:43:33.772 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.814 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.048) 0:00:08.679 ********* 2020-04-28T12:43:33.832 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.858 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.044) 0:00:08.723 ********* 2020-04-28T12:43:33.865 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-04-28T12:43:33.866 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.903 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.044) 0:00:08.768 ********* 2020-04-28T12:43:33.914 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.947 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.044) 0:00:08.812 ********* 2020-04-28T12:43:33.954 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:33.991 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:33 +0000 (0:00:00.043) 0:00:08.856 ********* 2020-04-28T12:43:33.996 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-04-28T12:43:33.997 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.041 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:34 +0000 (0:00:00.050) 0:00:08.907 ********* 2020-04-28T12:43:34.047 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-04-28T12:43:34.048 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.087 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:34 +0000 (0:00:00.044) 0:00:08.951 ********* 2020-04-28T12:43:34.092 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:43:34.093 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.093 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.095 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.095 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.107 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.108 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.144 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:34 +0000 (0:00:00.058) 0:00:09.010 ********* 2020-04-28T12:43:34.150 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-04-28T12:43:34.152 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.152 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.154 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.155 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.167 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.167 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.178 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.179 INFO:teuthology.task.ansible.out: skipping: [smithi026.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.190 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.191 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.201 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.202 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.203 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.216 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.225 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.226 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.227 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.227 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.239 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.239 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.241 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.251 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.252 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.253 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.264 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.264 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.265 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.276 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.277 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.278 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.279 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.291 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.291 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.293 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.303 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.304 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.305 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.317 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.317 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.319 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.329 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.331 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.332 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.365 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.408 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:34 +0000 (0:00:00.263) 0:00:09.273 ********* 2020-04-28T12:43:34.416 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.420 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.426 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.430 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:34.479 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:34 +0000 (0:00:00.066) 0:00:09.339 ********* 2020-04-28T12:43:35.179 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-04-28T12:43:35.181 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-28T12:43:35.216 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.742) 0:00:10.082 ********* 2020-04-28T12:43:35.223 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "f9ee21bf558da16d5cb117fdaf10268934dc9dad", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-04-28T12:43:35.261 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.044) 0:00:10.126 ********* 2020-04-28T12:43:35.266 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-04-28T12:43:35.267 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => { "msg": "Host smithi107.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:43:35.305 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.043) 0:00:10.170 ********* 2020-04-28T12:43:35.309 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => { "msg": "Host smithi026.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-04-28T12:43:35.353 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.048) 0:00:10.218 ********* 2020-04-28T12:43:35.359 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-04-28T12:43:35.359 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:43:35.401 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.048) 0:00:10.267 ********* 2020-04-28T12:43:35.408 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-04-28T12:43:35.446 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.044) 0:00:10.311 ********* 2020-04-28T12:43:35.457 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-04-28T12:43:35.459 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:35.495 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.049) 0:00:10.361 ********* 2020-04-28T12:43:35.501 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:35.538 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.043) 0:00:10.404 ********* 2020-04-28T12:43:35.764 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-04-28T12:43:35.764 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.072157", "end": "2020-04-28 12:43:35.742060", "rc": 0, "start": "2020-04-28 12:43:35.669903", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:43:35.809 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.270) 0:00:10.674 ********* 2020-04-28T12:43:35.838 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.085308", "end": "2020-04-28 12:43:35.811955", "rc": 0, "start": "2020-04-28 12:43:35.726647", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-04-28T12:43:35.838 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:35.879 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.067) 0:00:10.742 ********* 2020-04-28T12:43:35.912 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.035) 0:00:10.777 ********* 2020-04-28T12:43:35.917 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:35.960 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.048) 0:00:10.825 ********* 2020-04-28T12:43:35.965 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-04-28T12:43:35.966 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.005 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:35 +0000 (0:00:00.045) 0:00:10.870 ********* 2020-04-28T12:43:36.016 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.056 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.050) 0:00:10.921 ********* 2020-04-28T12:43:36.062 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-04-28T12:43:36.063 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.102 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.046) 0:00:10.967 ********* 2020-04-28T12:43:36.109 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.149 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.047) 0:00:11.014 ********* 2020-04-28T12:43:36.155 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-04-28T12:43:36.156 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.195 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.045) 0:00:11.060 ********* 2020-04-28T12:43:36.202 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.241 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.046) 0:00:11.106 ********* 2020-04-28T12:43:36.246 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-04-28T12:43:36.250 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.287 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.046) 0:00:11.153 ********* 2020-04-28T12:43:36.293 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.331 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.043) 0:00:11.196 ********* 2020-04-28T12:43:36.336 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-04-28T12:43:36.338 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.376 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.044) 0:00:11.241 ********* 2020-04-28T12:43:36.381 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.425 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.049) 0:00:11.290 ********* 2020-04-28T12:43:36.432 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-04-28T12:43:36.432 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.434 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.488 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.062) 0:00:11.353 ********* 2020-04-28T12:43:36.493 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.493 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.538 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.044) 0:00:11.397 ********* TASK [common : Set have_entitlements] ****************************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.576 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.044) 0:00:11.442 ********* 2020-04-28T12:43:36.582 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.620 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.043) 0:00:11.485 ********* 2020-04-28T12:43:36.625 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-04-28T12:43:36.627 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.668 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.047) 0:00:11.533 ********* 2020-04-28T12:43:36.675 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.715 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.044) 0:00:11.577 ********* 2020-04-28T12:43:36.717 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-04-28T12:43:36.719 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.757 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.045) 0:00:11.623 ********* 2020-04-28T12:43:36.765 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.801 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.043) 0:00:11.666 ********* 2020-04-28T12:43:36.807 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.847 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.042) 0:00:11.709 ********* 2020-04-28T12:43:36.851 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:36.888 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.043) 0:00:11.753 ********* 2020-04-28T12:43:36.895 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-04-28T12:43:36.896 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.937 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.048) 0:00:11.802 ********* 2020-04-28T12:43:36.941 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:36.982 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:36 +0000 (0:00:00.044) 0:00:11.847 ********* 2020-04-28T12:43:36.987 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-04-28T12:43:36.988 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.033 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.051) 0:00:11.898 ********* 2020-04-28T12:43:37.038 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.078 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.045) 0:00:11.944 ********* 2020-04-28T12:43:37.085 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-04-28T12:43:37.085 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.154 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.064) 0:00:12.008 ********* 2020-04-28T12:43:37.394 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.428 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.286) 0:00:12.294 ********* 2020-04-28T12:43:37.434 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-04-28T12:43:37.436 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.481 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.052) 0:00:12.346 ********* 2020-04-28T12:43:37.486 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.535 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.054) 0:00:12.400 ********* 2020-04-28T12:43:37.541 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-04-28T12:43:37.543 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.583 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.047) 0:00:12.448 ********* 2020-04-28T12:43:37.587 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.632 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.045) 0:00:12.493 ********* 2020-04-28T12:43:37.635 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi107.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:37.673 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.044) 0:00:12.538 ********* 2020-04-28T12:43:37.679 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:37.716 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.043) 0:00:12.582 ********* 2020-04-28T12:43:37.722 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:43:37.724 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.761 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.044) 0:00:12.627 ********* 2020-04-28T12:43:37.767 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.808 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.046) 0:00:12.673 ********* 2020-04-28T12:43:37.813 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-04-28T12:43:37.814 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.853 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.044) 0:00:12.717 ********* 2020-04-28T12:43:37.859 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.894 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.042) 0:00:12.759 ********* 2020-04-28T12:43:37.899 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-04-28T12:43:37.901 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.936 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.042) 0:00:12.802 ********* 2020-04-28T12:43:37.943 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:37.984 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:37 +0000 (0:00:00.047) 0:00:12.849 ********* 2020-04-28T12:43:37.989 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-04-28T12:43:37.990 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.027 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.041) 0:00:12.891 ********* 2020-04-28T12:43:38.034 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.079 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.053) 0:00:12.945 ********* 2020-04-28T12:43:38.085 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-04-28T12:43:38.085 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.123 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.043) 0:00:12.988 ********* 2020-04-28T12:43:38.127 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.164 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.041) 0:00:13.029 ********* 2020-04-28T12:43:38.170 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-04-28T12:43:38.172 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.207 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.043) 0:00:13.073 ********* 2020-04-28T12:43:38.213 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.251 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.043) 0:00:13.116 ********* 2020-04-28T12:43:38.256 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-04-28T12:43:38.257 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:38.296 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.044) 0:00:13.161 ********* 2020-04-28T12:43:38.301 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-04-28T12:43:38.338 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.042) 0:00:13.204 ********* 2020-04-28T12:43:38.343 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-04-28T12:43:38.378 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.039) 0:00:13.244 ********* 2020-04-28T12:43:38.418 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.040) 0:00:13.284 ********* 2020-04-28T12:43:38.423 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-04-28T12:43:38.424 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.459 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.040) 0:00:13.325 ********* 2020-04-28T12:43:38.464 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:38.512 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.051) 0:00:13.377 ********* 2020-04-28T12:43:38.673 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-04-28T12:43:38.674 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:43:38.709 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.197) 0:00:13.574 ********* 2020-04-28T12:43:38.735 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:43:38.772 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:38 +0000 (0:00:00.063) 0:00:13.637 ********* 2020-04-28T12:43:39.200 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi107.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:43:39.291 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'enabled': u'1', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-04-28T12:43:39.660 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:43:39.703 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:39 +0000 (0:00:00.930) 0:00:14.568 ********* 2020-04-28T12:43:39.775 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'enabled': 0, u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-04-28T12:43:39.822 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:39 +0000 (0:00:00.118) 0:00:14.687 ********* 2020-04-28T12:43:40.205 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-04-28T12:43:40.206 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:43:40.365 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-04-28T12:43:40.689 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:43:40.729 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:40 +0000 (0:00:00.903) 0:00:15.590 ********* 2020-04-28T12:43:40.762 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:40.802 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:40 +0000 (0:00:00.073) 0:00:15.664 ********* 2020-04-28T12:43:40.825 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:40.865 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:40 +0000 (0:00:00.062) 0:00:15.727 ********* 2020-04-28T12:43:40.881 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi026.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-04-28T12:43:40.894 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-28T12:43:40.895 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:40.928 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:40 +0000 (0:00:00.066) 0:00:15.794 ********* 2020-04-28T12:43:40.963 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:40 +0000 (0:00:00.034) 0:00:15.828 ********* 2020-04-28T12:43:40.967 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-04-28T12:43:40.968 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.007 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.043) 0:00:15.872 ********* 2020-04-28T12:43:41.012 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-28T12:43:41.012 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.049 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.041) 0:00:15.914 ********* 2020-04-28T12:43:41.055 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:43:41.057 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.092 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.043) 0:00:15.957 ********* 2020-04-28T12:43:41.097 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:43:41.098 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.134 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.042) 0:00:15.999 ********* 2020-04-28T12:43:41.138 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-04-28T12:43:41.139 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.176 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.042) 0:00:16.042 ********* 2020-04-28T12:43:41.182 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-28T12:43:41.182 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.223 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.046) 0:00:16.089 ********* 2020-04-28T12:43:41.228 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-04-28T12:43:41.229 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.269 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.045) 0:00:16.134 ********* 2020-04-28T12:43:41.276 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-28T12:43:41.278 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.313 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.044) 0:00:16.178 ********* 2020-04-28T12:43:41.318 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-04-28T12:43:41.319 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.360 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.046) 0:00:16.225 ********* 2020-04-28T12:43:41.365 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-28T12:43:41.366 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.408 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.046) 0:00:16.271 ********* 2020-04-28T12:43:41.411 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-04-28T12:43:41.413 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.451 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.044) 0:00:16.316 ********* 2020-04-28T12:43:41.455 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-28T12:43:41.457 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.496 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.044) 0:00:16.361 ********* 2020-04-28T12:43:41.502 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-04-28T12:43:41.504 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.543 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.047) 0:00:16.408 ********* 2020-04-28T12:43:41.569 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-04-28T12:43:41.571 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.620 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.076) 0:00:16.485 ********* 2020-04-28T12:43:41.646 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-04-28T12:43:41.648 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:41.687 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:41 +0000 (0:00:00.066) 0:00:16.552 ********* 2020-04-28T12:43:42.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-04-28T12:43:42.524 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.833044", "end": "2020-04-28 12:43:42.500328", "rc": 0, "start": "2020-04-28 12:43:41.667284", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:43:42.525 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.629190", "end": "2020-04-28 12:43:42.500320", "rc": 0, "start": "2020-04-28 12:43:41.871130", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:43:42.564 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:42 +0000 (0:00:00.877) 0:00:17.429 ********* 2020-04-28T12:43:42.598 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:42 +0000 (0:00:00.034) 0:00:17.464 ********* 2020-04-28T12:43:43.711 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-04-28T12:43:43.711 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:43:43.747 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:43 +0000 (0:00:01.148) 0:00:18.612 ********* 2020-04-28T12:43:43.753 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-04-28T12:43:43.791 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:43 +0000 (0:00:00.044) 0:00:18.656 ********* 2020-04-28T12:43:43.796 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-04-28T12:43:43.798 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:43.836 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:43 +0000 (0:00:00.044) 0:00:18.701 ********* 2020-04-28T12:43:43.843 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:43.882 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:43 +0000 (0:00:00.045) 0:00:18.747 ********* 2020-04-28T12:43:43.887 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-04-28T12:43:43.889 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:43.931 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:43 +0000 (0:00:00.048) 0:00:18.796 ********* 2020-04-28T12:43:43.937 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:43.978 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:43 +0000 (0:00:00.047) 0:00:18.844 ********* 2020-04-28T12:43:43.983 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-04-28T12:43:43.984 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:44.030 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:44 +0000 (0:00:00.051) 0:00:18.895 ********* 2020-04-28T12:43:44.036 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:44.076 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:44 +0000 (0:00:00.045) 0:00:18.940 ********* 2020-04-28T12:43:44.080 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-04-28T12:43:44.080 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:44.118 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:44 +0000 (0:00:00.043) 0:00:18.983 ********* 2020-04-28T12:43:44.125 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:44.164 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:44 +0000 (0:00:00.045) 0:00:19.029 ********* 2020-04-28T12:43:44.607 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-04-28T12:43:44.608 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:43:44.646 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:44 +0000 (0:00:00.482) 0:00:19.511 ********* 2020-04-28T12:43:44.656 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-04-28T12:43:44.693 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:44 +0000 (0:00:00.046) 0:00:19.558 ********* 2020-04-28T12:43:45.592 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-04-28T12:43:45.593 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:43:45.630 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:45 +0000 (0:00:00.937) 0:00:20.495 ********* 2020-04-28T12:43:45.636 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-04-28T12:43:45.690 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:45 +0000 (0:00:00.059) 0:00:20.555 ********* 2020-04-28T12:43:46.146 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-04-28T12:43:46.148 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:43:46.210 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-04-28T12:43:46.624 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:43:46.697 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-04-28T12:43:47.045 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:43:47.085 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:47 +0000 (0:00:01.395) 0:00:21.951 ********* 2020-04-28T12:43:47.166 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-04-28T12:43:47.208 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:47 +0000 (0:00:00.122) 0:00:22.073 ********* 2020-04-28T12:43:47.286 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-04-28T12:43:47.287 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:43:47.327 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:47 +0000 (0:00:00.119) 0:00:22.192 ********* 2020-04-28T12:43:47.417 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:43:47.456 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:47 +0000 (0:00:00.129) 0:00:22.322 ********* 2020-04-28T12:43:47.790 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-28T12:43:47.791 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:43:47.947 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-04-28T12:43:48.234 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:43:48.391 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-04-28T12:43:48.665 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:43:48.706 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:48 +0000 (0:00:01.249) 0:00:23.571 ********* 2020-04-28T12:43:48.734 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-28T12:43:48.735 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:48.785 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:48 +0000 (0:00:00.078) 0:00:23.650 ********* 2020-04-28T12:43:48.821 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-28T12:43:48.822 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:43:48.864 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:48 +0000 (0:00:00.079) 0:00:23.730 ********* 2020-04-28T12:43:48.870 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-04-28T12:43:48.870 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-04-28T12:43:48.917 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:48 +0000 (0:00:00.052) 0:00:23.782 ********* 2020-04-28T12:43:48.942 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-04-28T12:43:48.944 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:48.983 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:48 +0000 (0:00:00.065) 0:00:23.848 ********* 2020-04-28T12:43:49.019 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-04-28T12:43:49.020 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-04-28T12:43:49.057 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:49 +0000 (0:00:00.074) 0:00:23.923 ********* 2020-04-28T12:43:49.062 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-28T12:43:49.064 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:43:49.101 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:49 +0000 (0:00:00.043) 0:00:23.966 ********* 2020-04-28T12:43:49.137 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi107.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:49.148 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:49.161 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:49.174 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:49.211 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:49 +0000 (0:00:00.109) 0:00:24.076 ********* 2020-04-28T12:43:49.268 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-04-28T12:43:49.270 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-04-28T12:43:49.308 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:49 +0000 (0:00:00.096) 0:00:24.173 ********* 2020-04-28T12:43:49.361 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-04-28T12:43:49.362 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:49.373 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:49.384 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:49.426 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:49 +0000 (0:00:00.115) 0:00:24.288 ********* 2020-04-28T12:43:50.130 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-28T12:43:50.131 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:43:50.172 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:50 +0000 (0:00:00.748) 0:00:25.037 ********* 2020-04-28T12:43:50.200 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-28T12:43:50.201 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:50.238 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:50 +0000 (0:00:00.066) 0:00:25.103 ********* 2020-04-28T12:43:50.420 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-04-28T12:43:50.422 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-04-28T12:43:50.459 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:50 +0000 (0:00:00.220) 0:00:25.324 ********* 2020-04-28T12:43:50.485 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-04-28T12:43:50.487 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:50.525 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:50 +0000 (0:00:00.063) 0:00:25.388 ********* 2020-04-28T12:43:50.707 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-04-28T12:43:50.708 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:43:50.746 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:50 +0000 (0:00:00.222) 0:00:25.610 ********* 2020-04-28T12:43:51.021 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-04-28T12:43:51.059 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.313) 0:00:25.924 ********* 2020-04-28T12:43:51.201 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:43:51.202 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:43:51.238 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.179) 0:00:26.103 ********* 2020-04-28T12:43:51.280 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-28T12:43:51.280 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:51.281 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:51.318 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.078) 0:00:26.182 ********* 2020-04-28T12:43:51.520 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-28T12:43:51.521 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:43:51.561 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.243) 0:00:26.426 ********* 2020-04-28T12:43:51.565 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-04-28T12:43:51.566 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-04-28T12:43:51.605 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.044) 0:00:26.470 ********* 2020-04-28T12:43:51.642 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-04-28T12:43:51.642 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:51.644 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-04-28T12:43:51.681 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.075) 0:00:26.546 ********* 2020-04-28T12:43:51.802 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-28T12:43:51.803 INFO:teuthology.task.ansible.out:fatal: [smithi107.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-28T12:43:51.839 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.158) 0:00:26.705 ********* 2020-04-28T12:43:51.869 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-28T12:43:51.871 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:51.908 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.068) 0:00:26.774 ********* 2020-04-28T12:43:51.913 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-04-28T12:43:51.914 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:43:51.950 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:51 +0000 (0:00:00.041) 0:00:26.815 ********* 2020-04-28T12:43:52.207 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-04-28T12:43:52.208 INFO:teuthology.task.ansible.out:fatal: [smithi026.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-04-28T12:43:52.246 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:52 +0000 (0:00:00.295) 0:00:27.111 ********* 2020-04-28T12:43:52.272 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-04-28T12:43:52.274 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:43:52.313 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:52 +0000 (0:00:00.067) 0:00:27.178 ********* 2020-04-28T12:43:52.383 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-04-28T12:43:52.383 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:43:52.427 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:52 +0000 (0:00:00.113) 0:00:27.291 ********* 2020-04-28T12:43:52.821 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-04-28T12:43:52.864 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:52 +0000 (0:00:00.438) 0:00:27.730 ********* 2020-04-28T12:43:53.174 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-04-28T12:43:53.177 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:41:56 UTC", "ActiveEnterTimestampMonotonic": "14699893", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target systemd-tmpfiles-setup.service sysinit.target tmp.mount system.slice time-sync.target var-run.mount nss-lookup.target -.mount network.target local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:41:56 UTC", "AssertTimestampMonotonic": "14699206", "Before": "shutdown.target multi-user.target xdm.service plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:41:56 UTC", "ConditionTimestampMonotonic": "14699205", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-28T12:43:53.178 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2488", "ExecMainStartTimestamp": "Tue 2020-04-28 12:41:56 UTC", "ExecMainStartTimestampMonotonic": "14699865", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:41:56 UTC] ; stop_time=[n/a] ; pid=2488 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:41:56 UTC", "InactiveExitTimestampMonotonic": "14699893", "InvocationID": "5422b2b2c6934adaa795e175cce1f9dc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-28T12:43:53.179 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2488", "MemoryAccounting": "yes", "MemoryCurrent": "1089536", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-28T12:43:53.181 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:41:56 UTC", "StateChangeTimestampMonotonic": "14699893", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:41:56 UTC", "WatchdogTimestampMonotonic": "14699893", "WatchdogUSec": "0"}} 2020-04-28T12:43:53.216 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:53 +0000 (0:00:00.351) 0:00:28.081 ********* 2020-04-28T12:43:53.224 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:42:13 UTC", "ActiveEnterTimestampMonotonic": "14249683", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount local-fs.target time-sync.target basic.target -.mount nss-lookup.target systemd-tmpfiles-setup.service network.target systemd-journald.socket sysinit.target system.slice tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:42:13 UTC", "AssertTimestampMonotonic": "14248790", "Before": "xdm.service getty@tty1.service plymouth-quit.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:42:13 UTC", "ConditionTimestampMonotonic": "14248790", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-04-28T12:43:53.225 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2492", "ExecMainStartTimestamp": "Tue 2020-04-28 12:42:13 UTC", "ExecMainStartTimestampMonotonic": "14249646", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Tue 2020-04-28 12:42:13 UTC] ; stop_time=[n/a] ; pid=2492 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:42:13 UTC", "InactiveExitTimestampMonotonic": "14249683", "InvocationID": "8322bdaea7a44e0d963f68341cbcf9ac", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-04-28T12:43:53.227 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127467", "LimitNPROCSoft": "127467", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127467", "LimitSIGPENDINGSoft": "127467", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2492", "MemoryAccounting": "yes", "MemoryCurrent": "1142784", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-04-28T12:43:53.228 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:42:13 UTC", "StateChangeTimestampMonotonic": "14249683", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:42:13 UTC", "WatchdogTimestampMonotonic": "14249682", "WatchdogUSec": "0"}} 2020-04-28T12:43:53.263 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:53 +0000 (0:00:00.046) 0:00:28.128 ********* 2020-04-28T12:43:53.414 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-04-28T12:43:53.415 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001641", "end": "2020-04-28 12:43:53.383225", "rc": 0, "start": "2020-04-28 12:43:53.381584", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:43:53.451 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:53 +0000 (0:00:00.188) 0:00:28.317 ********* 2020-04-28T12:43:53.478 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001793", "end": "2020-04-28 12:43:53.445630", "rc": 0, "start": "2020-04-28 12:43:53.443837", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-04-28T12:43:53.516 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:53 +0000 (0:00:00.064) 0:00:28.382 ********* 2020-04-28T12:43:54.376 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-04-28T12:43:54.377 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:43:54.413 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:54 +0000 (0:00:00.897) 0:00:29.279 ********* 2020-04-28T12:43:54.491 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-04-28T12:43:54.528 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:54 +0000 (0:00:00.114) 0:00:29.393 ********* 2020-04-28T12:43:55.325 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-04-28T12:43:55.327 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:43:55.363 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:55 +0000 (0:00:00.834) 0:00:30.228 ********* 2020-04-28T12:43:55.507 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-04-28T12:43:55.545 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:55 +0000 (0:00:00.182) 0:00:30.410 ********* 2020-04-28T12:43:56.596 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-04-28T12:43:56.599 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:43:56.634 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:56 +0000 (0:00:01.088) 0:00:31.499 ********* 2020-04-28T12:43:56.651 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-04-28T12:43:56.688 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:43:56 +0000 (0:00:00.054) 0:00:31.554 ********* 2020-04-28T12:44:12.956 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-28T12:44:12.958 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.072589", "end": "2020-04-28 12:44:12.931185", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:43:56.858596", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:44:12.997 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:12 +0000 (0:00:16.307) 0:00:47.861 ********* 2020-04-28T12:44:13.471 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-28T12:44:13.472 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:44:13.511 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:13 +0000 (0:00:00.513) 0:00:48.375 ********* 2020-04-28T12:44:13.673 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-04-28T12:44:13.674 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.827112", "end": "2020-04-28 12:44:13.642867", "failed_when_result": false, "rc": 0, "start": "2020-04-28 12:43:56.815755", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-04-28T12:44:13.714 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:13 +0000 (0:00:00.204) 0:00:48.580 ********* 2020-04-28T12:44:13.721 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-28T12:44:13.721 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.011443", "end": "2020-04-28 12:44:13.692368", "rc": 0, "start": "2020-04-28 12:44:13.680925", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:13.762 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:13 +0000 (0:00:00.045) 0:00:48.625 ********* 2020-04-28T12:44:13.964 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-28T12:44:13.966 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002029", "end": "2020-04-28 12:44:13.936810", "rc": 0, "start": "2020-04-28 12:44:13.934781", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:14.007 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:14 +0000 (0:00:00.247) 0:00:48.873 ********* 2020-04-28T12:44:14.220 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-04-28T12:44:14.221 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-04-28T12:44:14.263 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:14 +0000 (0:00:00.254) 0:00:49.128 ********* 2020-04-28T12:44:14.488 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-04-28T12:44:14.490 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.014980", "end": "2020-04-28 12:44:14.462840", "rc": 0, "start": "2020-04-28 12:44:14.447860", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:14.526 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:14 +0000 (0:00:00.262) 0:00:49.391 ********* 2020-04-28T12:44:14.734 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-04-28T12:44:14.735 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002186", "end": "2020-04-28 12:44:14.713196", "rc": 0, "start": "2020-04-28 12:44:14.711010", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:14.778 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:14 +0000 (0:00:00.252) 0:00:49.643 ********* 2020-04-28T12:44:30.250 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-28T12:44:30.252 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.045249", "end": "2020-04-28 12:44:30.220197", "rc": 0, "start": "2020-04-28 12:44:14.174948", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:30.288 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:30 +0000 (0:00:15.509) 0:01:05.153 ********* 2020-04-28T12:44:30.496 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-28T12:44:30.498 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:44:30.533 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:30 +0000 (0:00:00.245) 0:01:05.399 ********* 2020-04-28T12:44:30.570 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-28T12:44:30.570 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:44:30.608 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:30 +0000 (0:00:00.075) 0:01:05.474 ********* 2020-04-28T12:44:30.646 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:44:30.648 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:44:30.691 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:30 +0000 (0:00:00.082) 0:01:05.556 ********* 2020-04-28T12:44:30.731 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:44:30.732 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:44:30.772 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:30 +0000 (0:00:00.081) 0:01:05.638 ********* 2020-04-28T12:44:30.809 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-28T12:44:30.811 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:44:30.853 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:30 +0000 (0:00:00.080) 0:01:05.718 ********* 2020-04-28T12:44:31.049 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-28T12:44:31.051 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:44:31.086 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:31 +0000 (0:00:00.233) 0:01:05.952 ********* 2020-04-28T12:44:31.282 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-04-28T12:44:31.284 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:44:31.329 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:31 +0000 (0:00:00.242) 0:01:06.194 ********* 2020-04-28T12:44:31.355 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:44:31.356 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:31.393 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:31 +0000 (0:00:00.063) 0:01:06.258 ********* 2020-04-28T12:44:31.418 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-28T12:44:31.420 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:31.459 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:31 +0000 (0:00:00.066) 0:01:06.325 ********* 2020-04-28T12:44:31.687 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-28T12:44:31.689 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:44:31.726 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:31 +0000 (0:00:00.266) 0:01:06.591 ********* 2020-04-28T12:44:31.754 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-04-28T12:44:31.754 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.758464", "end": "2020-04-28 12:44:31.720279", "rc": 0, "start": "2020-04-28 12:44:14.961815", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:31.803 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:31 +0000 (0:00:00.077) 0:01:06.669 ********* 2020-04-28T12:44:32.022 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-04-28T12:44:32.023 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-04-28T12:44:32.070 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.265) 0:01:06.934 ********* 2020-04-28T12:44:32.097 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-04-28T12:44:32.098 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-04-28T12:44:32.138 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.069) 0:01:07.003 ********* 2020-04-28T12:44:32.184 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-04-28T12:44:32.186 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:44:32.224 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.086) 0:01:07.090 ********* 2020-04-28T12:44:32.261 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-04-28T12:44:32.265 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-04-28T12:44:32.305 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.080) 0:01:07.170 ********* 2020-04-28T12:44:32.321 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-28T12:44:32.326 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:44:32.362 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.057) 0:01:07.228 ********* 2020-04-28T12:44:32.371 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-04-28T12:44:32.371 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-04-28T12:44:32.412 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.049) 0:01:07.277 ********* 2020-04-28T12:44:32.417 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-04-28T12:44:32.418 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi107"}, "changed": false} 2020-04-28T12:44:32.458 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.046) 0:01:07.323 ********* 2020-04-28T12:44:32.620 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-04-28T12:44:32.622 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-04-28T12:44:32.657 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.199) 0:01:07.522 ********* 2020-04-28T12:44:32.877 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "name": "ubuntu", "state": "present", "system": false} 2020-04-28T12:44:32.924 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.266) 0:01:07.789 ********* 2020-04-28T12:44:32.950 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-04-28T12:44:32.951 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:32.999 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:32 +0000 (0:00:00.075) 0:01:07.864 ********* 2020-04-28T12:44:33.027 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-04-28T12:44:33.029 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:33.077 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:33 +0000 (0:00:00.077) 0:01:07.942 ********* 2020-04-28T12:44:33.314 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-04-28T12:44:33.315 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-04-28T12:44:33.359 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:33 +0000 (0:00:00.282) 0:01:08.224 ********* 2020-04-28T12:44:33.470 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-28T12:44:33.471 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi107", "ansible_hostname": "smithi107", "ansible_nodename": "smithi107"}, "changed": false, "name": "smithi107"} 2020-04-28T12:44:33.511 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:33 +0000 (0:00:00.152) 0:01:08.377 ********* 2020-04-28T12:44:33.942 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-04-28T12:44:33.943 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-04-28T12:44:33.987 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:33 +0000 (0:00:00.475) 0:01:08.852 ********* 2020-04-28T12:44:34.013 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-28T12:44:34.014 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:44:34.016 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi026"}, "changed": false} 2020-04-28T12:44:34.052 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:34 +0000 (0:00:00.065) 0:01:08.918 ********* 2020-04-28T12:44:34.086 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:34 +0000 (0:00:00.033) 0:01:08.951 ********* 2020-04-28T12:44:34.561 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-28T12:44:34.561 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:44:34.600 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:34 +0000 (0:00:00.514) 0:01:09.466 ********* 2020-04-28T12:44:34.637 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-04-28T12:44:34.639 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi026", "ansible_hostname": "smithi026", "ansible_nodename": "smithi026"}, "changed": false, "name": "smithi026"} 2020-04-28T12:44:34.676 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:34 +0000 (0:00:00.075) 0:01:09.541 ********* 2020-04-28T12:44:35.170 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-04-28T12:44:35.172 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-04-28T12:44:35.208 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:35 +0000 (0:00:00.531) 0:01:10.073 ********* 2020-04-28T12:44:35.289 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-28T12:44:35.290 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:44:35.327 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:35 +0000 (0:00:00.118) 0:01:10.192 ********* 2020-04-28T12:44:35.701 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-04-28T12:44:35.701 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-04-28T12:44:35.741 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:35 +0000 (0:00:00.413) 0:01:10.606 ********* 2020-04-28T12:44:35.821 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-28T12:44:35.821 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:44:35.866 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:35 +0000 (0:00:00.124) 0:01:10.731 ********* 2020-04-28T12:44:36.069 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:44:36.071 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:44:36.118 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:36 +0000 (0:00:00.252) 0:01:10.984 ********* 2020-04-28T12:44:36.315 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:44:36.317 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:44:36.357 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:36 +0000 (0:00:00.238) 0:01:11.222 ********* 2020-04-28T12:44:36.425 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-04-28T12:44:36.426 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-04-28T12:44:36.467 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:36 +0000 (0:00:00.110) 0:01:11.332 ********* 2020-04-28T12:44:36.578 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:44:36.579 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:44:36.619 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:36 +0000 (0:00:00.152) 0:01:11.484 ********* 2020-04-28T12:44:36.976 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-04-28T12:44:36.977 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-04-28T12:44:37.027 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:37 +0000 (0:00:00.403) 0:01:11.888 ********* 2020-04-28T12:44:37.102 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:44:37.102 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:44:37.140 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:37 +0000 (0:00:00.117) 0:01:12.005 ********* 2020-04-28T12:44:37.240 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:44:37.240 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:44:37.281 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:37 +0000 (0:00:00.141) 0:01:12.147 ********* 2020-04-28T12:44:37.492 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:44:37.493 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-04-28T12:44:37.531 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:37 +0000 (0:00:00.250) 0:01:12.397 ********* 2020-04-28T12:44:37.624 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:44:37.625 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:44:37.668 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:37 +0000 (0:00:00.136) 0:01:12.533 ********* 2020-04-28T12:44:37.773 INFO:teuthology.task.ansible.out: 2020-04-28T12:44:37.775 INFO:teuthology.task.ansible.out:TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi026.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1214, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-04-28T12:44:37.819 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:37 +0000 (0:00:00.151) 0:01:12.685 ********* 2020-04-28T12:44:38.327 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-04-28T12:44:38.363 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:38 +0000 (0:00:00.543) 0:01:13.229 ********* 2020-04-28T12:44:38.881 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:44:38.883 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-04-28T12:44:38.918 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:38 +0000 (0:00:00.554) 0:01:13.783 ********* 2020-04-28T12:44:39.558 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:44:39.560 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.696602", "end": "2020-04-28 12:44:39.533969", "rc": 0, "start": "2020-04-28 12:44:37.837367", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:39.599 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:39 +0000 (0:00:00.680) 0:01:14.464 ********* 2020-04-28T12:44:40.162 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:44:40.163 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "md5sum": "fc4d6b297f53d9e012b8d55e69bcfab2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077879.63-152136816589240/source", "state": "file", "uid": 0} 2020-04-28T12:44:40.716 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "md5sum": "4f98fa7e2e6141a46e754fa9f9c2b9eb", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077880.17-193363992042956/source", "state": "file", "uid": 0} 2020-04-28T12:44:40.979 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:44:40.979 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.854519", "end": "2020-04-28 12:44:40.953459", "rc": 0, "start": "2020-04-28 12:44:39.098940", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:44:41.024 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:41 +0000 (0:00:01.425) 0:01:15.890 ********* 2020-04-28T12:44:41.241 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-04-28T12:44:41.242 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "md5sum": "a5b5f274009ed88a68fc3eeb6fdcc339", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077880.73-99966321993434/source", "state": "file", "uid": 0} 2020-04-28T12:44:41.289 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:41 +0000 (0:00:00.264) 0:01:16.154 ********* 2020-04-28T12:44:41.640 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "md5sum": "fc4d6b297f53d9e012b8d55e69bcfab2", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077881.07-184717647922029/source", "state": "file", "uid": 0} 2020-04-28T12:44:41.791 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-28T12:44:41.792 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:44:41.830 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:41 +0000 (0:00:00.541) 0:01:16.696 ********* 2020-04-28T12:44:42.192 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** changed: [smithi026.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "md5sum": "4f98fa7e2e6141a46e754fa9f9c2b9eb", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077881.64-135366152117550/source", "state": "file", "uid": 0} 2020-04-28T12:44:42.320 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi107.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:44:42.742 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** changed: [smithi026.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "md5sum": "a5b5f274009ed88a68fc3eeb6fdcc339", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1588077882.2-162617944114228/source", "state": "file", "uid": 0} 2020-04-28T12:44:42.792 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:42 +0000 (0:00:00.961) 0:01:17.657 ********* 2020-04-28T12:44:42.793 INFO:teuthology.task.ansible.out: 2020-04-28T12:44:42.800 INFO:teuthology.task.ansible.out: 2020-04-28T12:44:42.801 INFO:teuthology.task.ansible.out:TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi107.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:44:43.258 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:44:43.312 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:43 +0000 (0:00:00.520) 0:01:18.177 ********* 2020-04-28T12:44:43.328 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-04-28T12:44:43.329 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-04-28T12:44:43.382 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:43 +0000 (0:00:00.061) 0:01:18.239 ********* 2020-04-28T12:44:43.812 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** changed: [smithi107.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.287424", "end": "2020-04-28 12:44:43.784159", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:44:43.496735", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-04-28T12:44:43.855 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:43 +0000 (0:00:00.481) 0:01:18.721 ********* 2020-04-28T12:44:43.894 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-04-28T12:44:43.894 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:43.962 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:43 +0000 (0:00:00.106) 0:01:18.827 ********* 2020-04-28T12:44:43.968 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:44:43.969 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', u'name': u'CentOS-$releasever - Base'}, 'key': u'CentOS-Base'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-04-28T12:44:44.004 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi107.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:44:44.006 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:44:44.044 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.082) 0:01:18.909 ********* 2020-04-28T12:44:44.071 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-28T12:44:44.073 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:44.109 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.065) 0:01:18.974 ********* 2020-04-28T12:44:44.147 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:44:44.147 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:44:44.191 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.082) 0:01:19.057 ********* 2020-04-28T12:44:44.228 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-28T12:44:44.230 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:44.264 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.072) 0:01:19.129 ********* 2020-04-28T12:44:44.301 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-28T12:44:44.302 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:44.341 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.076) 0:01:19.206 ********* 2020-04-28T12:44:44.412 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:44:44.414 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', u'name': u'CentOS-$releasever - AppStream'}, 'key': u'CentOS-AppStream'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-04-28T12:44:44.561 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-28T12:44:44.563 INFO:teuthology.task.ansible.out:fatal: [smithi107.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006695", "end": "2020-04-28 12:44:44.529773", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:44:44.523078", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:44:44.601 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.259) 0:01:19.466 ********* 2020-04-28T12:44:44.649 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-28T12:44:44.650 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:44.699 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.098) 0:01:19.565 ********* 2020-04-28T12:44:44.906 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-04-28T12:44:44.907 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 1, u'gpgkey': u'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial', u'enabled': 1, u'mirrorlist': u'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', u'name': u'CentOS-$releasever - Extras'}, 'key': u'CentOS-Extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-04-28T12:44:44.949 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:44 +0000 (0:00:00.249) 0:01:19.814 ********* 2020-04-28T12:44:45.486 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-04-28T12:44:45.486 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.301776", "end": "2020-04-28 12:44:45.454507", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-04-28 12:44:45.152731", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-04-28T12:44:45.525 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:45 +0000 (0:00:00.575) 0:01:20.390 ********* 2020-04-28T12:44:45.553 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:45.588 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:45 +0000 (0:00:00.063) 0:01:20.453 ********* 2020-04-28T12:44:45.625 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-04-28T12:44:45.626 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:44:45.636 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:44:45.675 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:45 +0000 (0:00:00.086) 0:01:20.540 ********* 2020-04-28T12:44:45.701 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-04-28T12:44:45.703 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:45.738 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:45 +0000 (0:00:00.062) 0:01:20.603 ********* 2020-04-28T12:44:45.774 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:44:45.776 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-04-28T12:44:45.812 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:45 +0000 (0:00:00.074) 0:01:20.677 ********* 2020-04-28T12:44:45.860 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-04-28T12:44:45.862 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:45.897 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:45 +0000 (0:00:00.084) 0:01:20.762 ********* 2020-04-28T12:44:45.933 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-04-28T12:44:45.935 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:45.971 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:45 +0000 (0:00:00.074) 0:01:20.836 ********* 2020-04-28T12:44:46.196 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-04-28T12:44:46.197 INFO:teuthology.task.ansible.out:fatal: [smithi026.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006965", "end": "2020-04-28 12:44:46.170455", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:44:46.163490", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-04-28T12:44:46.233 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:46 +0000 (0:00:00.261) 0:01:21.098 ********* 2020-04-28T12:44:46.269 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-04-28T12:44:46.271 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:44:46.307 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:46 +0000 (0:00:00.074) 0:01:21.173 ********* 2020-04-28T12:44:46.938 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:44:46.939 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:44:46.976 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:46 +0000 (0:00:00.668) 0:01:21.841 ********* 2020-04-28T12:44:48.574 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:44:48.623 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:48 +0000 (0:00:01.643) 0:01:23.484 ********* 2020-04-28T12:44:50.047 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64"]} 2020-04-28T12:44:50.084 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:50 +0000 (0:00:01.465) 0:01:24.950 ********* 2020-04-28T12:44:51.968 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch", "Removed: hdparm-9.54-2.el8.x86_64"]} 2020-04-28T12:44:52.006 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:52 +0000 (0:00:01.922) 0:01:26.872 ********* 2020-04-28T12:44:55.144 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** 2020-04-28T12:44:55.145 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.828873", "end": "2020-04-28 12:44:55.114170", "rc": 0, "start": "2020-04-28 12:44:50.285297", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 132 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 77 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 \nlab-extras 1.3 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:44:50 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n==================================================== 2020-04-28T12:44:55.147 INFO:teuthology.task.ansible.out:============================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 132 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 77 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 148 kB/s | 4.7 kB 00:00 ", "lab-extras 1.3 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:44:50 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:44:55.184 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:55 +0000 (0:00:03.177) 0:01:30.050 ********* 2020-04-28T12:44:57.232 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:04.998386", "end": "2020-04-28 12:44:57.203590", "rc": 0, "start": "2020-04-28 12:44:52.205204", "stderr": "No match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"", "stderr_lines": ["No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\""], "stdout": "CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 132 kB/s | 3.9 kB 00:00 \nCentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 \nlab-extras 1.1 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:44:52 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n==================================================== 2020-04-28T12:44:57.234 INFO:teuthology.task.ansible.out:============================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 142 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 132 kB/s | 3.9 kB 00:00 ", "CentOS-8 - Extras 52 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 67 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 149 kB/s | 4.7 kB 00:00 ", "lab-extras 1.1 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:03 ago on Tue 28 Apr 2020 12:44:52 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-04-28T12:44:57.282 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:44:57 +0000 (0:00:02.093) 0:01:32.143 ********* 2020-04-28T12:45:03.004 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:45:03.005 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:45:03.051 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:03 +0000 (0:00:05.773) 0:01:37.917 ********* 2020-04-28T12:45:03.094 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:45:03.095 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:03.140 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:03 +0000 (0:00:00.088) 0:01:38.005 ********* 2020-04-28T12:45:04.067 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:45:04.068 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:45:04.105 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:04 +0000 (0:00:00.965) 0:01:38.971 ********* 2020-04-28T12:45:04.143 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:45:04.145 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:04.192 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:04 +0000 (0:00:00.086) 0:01:39.057 ********* 2020-04-28T12:45:04.503 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-28T12:45:04.505 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target system.slice basic.target polkit.service dbus.socket dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service ebtables.service shutdown.target iptables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-28T12:45:04.507 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", 2020-04-28T12:45:04.509 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-28T12:45:04.510 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-04-28T12:45:04.544 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:04 +0000 (0:00:00.352) 0:01:39.409 ********* 2020-04-28T12:45:04.842 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-28T12:45:04.844 INFO:teuthology.task.ansible.out:fatal: [smithi107.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:45:04.882 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:04 +0000 (0:00:00.335) 0:01:39.745 ********* 2020-04-28T12:45:05.411 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:45:05.412 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-04-28T12:45:05.455 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:05 +0000 (0:00:00.574) 0:01:40.320 ********* 2020-04-28T12:45:05.493 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-04-28T12:45:05.494 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:05.534 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:05 +0000 (0:00:00.079) 0:01:40.399 ********* 2020-04-28T12:45:05.604 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-04-28T12:45:05.606 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-28T12:45:05.655 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:05 +0000 (0:00:00.121) 0:01:40.520 ********* 2020-04-28T12:45:05.683 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-28T12:45:05.685 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:05.724 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:05 +0000 (0:00:00.069) 0:01:40.590 ********* 2020-04-28T12:45:05.753 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-28T12:45:05.793 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:05 +0000 (0:00:00.067) 0:01:40.657 ********* 2020-04-28T12:45:05.831 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-28T12:45:05.832 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:05.867 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:05 +0000 (0:00:00.075) 0:01:40.733 ********* 2020-04-28T12:45:05.894 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-28T12:45:05.896 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:05.934 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:05 +0000 (0:00:00.066) 0:01:40.800 ********* 2020-04-28T12:45:05.971 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-28T12:45:05.973 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:05.986 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.031 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.088) 0:01:40.888 ********* 2020-04-28T12:45:06.050 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-28T12:45:06.052 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.094 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.071) 0:01:40.960 ********* 2020-04-28T12:45:06.121 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-28T12:45:06.162 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.065) 0:01:41.025 ********* 2020-04-28T12:45:06.186 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-28T12:45:06.188 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.228 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.066) 0:01:41.092 ********* 2020-04-28T12:45:06.253 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-28T12:45:06.254 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.292 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.065) 0:01:41.158 ********* 2020-04-28T12:45:06.319 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-04-28T12:45:06.320 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.357 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.064) 0:01:41.222 ********* 2020-04-28T12:45:06.385 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.426 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.068) 0:01:41.291 ********* 2020-04-28T12:45:06.452 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-28T12:45:06.453 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.489 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.062) 0:01:41.354 ********* 2020-04-28T12:45:06.515 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:45:06.517 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.554 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.064) 0:01:41.419 ********* 2020-04-28T12:45:06.559 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:45:06.560 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-04-28T12:45:06.602 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.048) 0:01:41.467 ********* 2020-04-28T12:45:06.607 INFO:teuthology.task.ansible.out: 2020-04-28T12:45:06.608 INFO:teuthology.task.ansible.out:TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.667 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.065) 0:01:41.533 ********* 2020-04-28T12:45:06.674 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:45:06.676 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.721 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.053) 0:01:41.587 ********* 2020-04-28T12:45:06.730 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-28T12:45:06.732 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.770 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.048) 0:01:41.636 ********* 2020-04-28T12:45:06.796 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-04-28T12:45:06.798 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.840 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.069) 0:01:41.705 ********* 2020-04-28T12:45:06.866 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-28T12:45:06.868 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.906 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.066) 0:01:41.771 ********* 2020-04-28T12:45:06.947 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-28T12:45:06.948 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:06.987 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:06 +0000 (0:00:00.080) 0:01:41.852 ********* 2020-04-28T12:45:07.013 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-28T12:45:07.015 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.056 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.068) 0:01:41.921 ********* 2020-04-28T12:45:07.073 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-04-28T12:45:07.075 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target system.slice basic.target polkit.service dbus.socket dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ebtables.service ipset.service iptables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-04-28T12:45:07.076 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127467", "LimitNPROCSoft": "127467", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127467", 2020-04-28T12:45:07.078 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127467", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-04-28T12:45:07.079 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.114 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.058) 0:01:41.980 ********* 2020-04-28T12:45:07.147 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.032) 0:01:42.012 ********* 2020-04-28T12:45:07.176 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-28T12:45:07.177 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.213 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.065) 0:01:42.078 ********* 2020-04-28T12:45:07.242 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.276 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.063) 0:01:42.141 ********* 2020-04-28T12:45:07.303 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:45:07.304 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.338 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.062) 0:01:42.204 ********* 2020-04-28T12:45:07.365 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:45:07.367 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.417 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.078) 0:01:42.282 ********* 2020-04-28T12:45:07.434 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-04-28T12:45:07.435 INFO:teuthology.task.ansible.out:fatal: [smithi026.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-04-28T12:45:07.472 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.054) 0:01:42.337 ********* 2020-04-28T12:45:07.477 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:45:07.479 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.516 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.044) 0:01:42.382 ********* 2020-04-28T12:45:07.543 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-04-28T12:45:07.544 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.581 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.064) 0:01:42.446 ********* 2020-04-28T12:45:07.608 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-04-28T12:45:07.610 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.645 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.064) 0:01:42.511 ********* 2020-04-28T12:45:07.671 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:45:07.673 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.709 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.063) 0:01:42.574 ********* 2020-04-28T12:45:07.736 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:45:07.737 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.783 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.064) 0:01:42.639 ********* TASK [testnode : Enable SELinux] *********************************************** ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-04-28T12:45:07.823 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.049) 0:01:42.688 ********* 2020-04-28T12:45:07.829 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:07.829 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.871 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.048) 0:01:42.737 ********* 2020-04-28T12:45:07.876 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-04-28T12:45:07.877 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.932 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.060) 0:01:42.797 ********* 2020-04-28T12:45:07.943 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:45:07.945 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:07.982 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:07 +0000 (0:00:00.050) 0:01:42.848 ********* 2020-04-28T12:45:07.988 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-04-28T12:45:08.027 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.044) 0:01:42.892 ********* 2020-04-28T12:45:08.032 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:45:08.034 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.071 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.044) 0:01:42.937 ********* 2020-04-28T12:45:08.077 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-04-28T12:45:08.079 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.117 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.045) 0:01:42.982 ********* 2020-04-28T12:45:08.130 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.163 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.046) 0:01:43.029 ********* 2020-04-28T12:45:08.169 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-04-28T12:45:08.179 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.216 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.052) 0:01:43.081 ********* 2020-04-28T12:45:08.222 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:45:08.222 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.262 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.046) 0:01:43.127 ********* 2020-04-28T12:45:08.266 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-04-28T12:45:08.269 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.270 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.309 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.047) 0:01:43.175 ********* 2020-04-28T12:45:08.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-04-28T12:45:08.337 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.373 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.063) 0:01:43.239 ********* 2020-04-28T12:45:08.411 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-04-28T12:45:08.453 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.079) 0:01:43.319 ********* 2020-04-28T12:45:08.492 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-04-28T12:45:08.493 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-28T12:45:08.530 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.076) 0:01:43.395 ********* 2020-04-28T12:45:08.565 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.035) 0:01:43.431 ********* 2020-04-28T12:45:08.570 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-04-28T12:45:08.570 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.609 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.043) 0:01:43.474 ********* 2020-04-28T12:45:08.636 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.673 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.064) 0:01:43.538 ********* 2020-04-28T12:45:08.701 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:45:08.703 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.739 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.066) 0:01:43.605 ********* 2020-04-28T12:45:08.766 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-04-28T12:45:08.767 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.806 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.066) 0:01:43.671 ********* 2020-04-28T12:45:08.812 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:45:08.814 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:45:08.857 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.051) 0:01:43.722 ********* 2020-04-28T12:45:08.864 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:45:08.865 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.904 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.047) 0:01:43.769 ********* 2020-04-28T12:45:08.931 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-04-28T12:45:08.932 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:08.970 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:08 +0000 (0:00:00.065) 0:01:43.835 ********* 2020-04-28T12:45:08.998 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-04-28T12:45:08.998 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.037 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.067) 0:01:43.903 ********* 2020-04-28T12:45:09.039 INFO:teuthology.task.ansible.out: 2020-04-28T12:45:09.067 INFO:teuthology.task.ansible.out: 2020-04-28T12:45:09.069 INFO:teuthology.task.ansible.out:TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:45:09.070 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.109 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.071) 0:01:43.974 ********* 2020-04-28T12:45:09.146 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.036) 0:01:44.011 ********* 2020-04-28T12:45:09.151 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-04-28T12:45:09.152 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.192 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.046) 0:01:44.057 ********* 2020-04-28T12:45:09.199 INFO:teuthology.task.ansible.out: 2020-04-28T12:45:09.201 INFO:teuthology.task.ansible.out:TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.240 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.048) 0:01:44.106 ********* 2020-04-28T12:45:09.246 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-04-28T12:45:09.247 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.286 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.045) 0:01:44.151 ********* 2020-04-28T12:45:09.293 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:45:09.296 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.336 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.049) 0:01:44.201 ********* 2020-04-28T12:45:09.343 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-04-28T12:45:09.344 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.385 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.049) 0:01:44.251 ********* 2020-04-28T12:45:09.392 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:45:09.393 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.436 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.050) 0:01:44.301 ********* 2020-04-28T12:45:09.441 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-04-28T12:45:09.443 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.483 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.047) 0:01:44.348 ********* 2020-04-28T12:45:09.489 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:45:09.491 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.527 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.044) 0:01:44.393 ********* 2020-04-28T12:45:09.532 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-04-28T12:45:09.535 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.573 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.045) 0:01:44.438 ********* 2020-04-28T12:45:09.579 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:45:09.580 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.619 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.046) 0:01:44.484 ********* 2020-04-28T12:45:09.625 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-04-28T12:45:09.627 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.669 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.050) 0:01:44.535 ********* 2020-04-28T12:45:09.675 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:45:09.676 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.713 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.043) 0:01:44.579 ********* 2020-04-28T12:45:09.719 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-04-28T12:45:09.720 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.759 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.045) 0:01:44.624 ********* 2020-04-28T12:45:09.766 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.804 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.045) 0:01:44.670 ********* 2020-04-28T12:45:09.811 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-04-28T12:45:09.812 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.863 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.058) 0:01:44.728 ********* 2020-04-28T12:45:09.870 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.909 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.046) 0:01:44.775 ********* 2020-04-28T12:45:09.915 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-04-28T12:45:09.916 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:09.955 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.045) 0:01:44.820 ********* 2020-04-28T12:45:09.960 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:45:09.962 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.002 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:09 +0000 (0:00:00.046) 0:01:44.867 ********* 2020-04-28T12:45:10.015 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.047 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.046) 0:01:44.913 ********* 2020-04-28T12:45:10.053 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:45:10.055 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.091 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.043) 0:01:44.956 ********* 2020-04-28T12:45:10.110 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.138 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.046) 0:01:45.003 ********* 2020-04-28T12:45:10.144 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-28T12:45:10.145 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.183 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.045) 0:01:45.048 ********* 2020-04-28T12:45:10.187 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-04-28T12:45:10.187 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.226 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.042) 0:01:45.091 ********* 2020-04-28T12:45:10.231 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:45:10.232 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.268 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.042) 0:01:45.133 ********* 2020-04-28T12:45:10.272 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-04-28T12:45:10.274 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.310 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.042) 0:01:45.176 ********* 2020-04-28T12:45:10.315 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:45:10.318 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.353 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.042) 0:01:45.219 ********* 2020-04-28T12:45:10.358 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:10.358 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.397 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.043) 0:01:45.262 ********* 2020-04-28T12:45:10.402 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:45:10.404 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.442 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.044) 0:01:45.307 ********* 2020-04-28T12:45:10.447 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-04-28T12:45:10.448 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.486 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.044) 0:01:45.351 ********* 2020-04-28T12:45:10.491 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-28T12:45:10.492 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.530 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.044) 0:01:45.396 ********* 2020-04-28T12:45:10.535 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-04-28T12:45:10.538 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.575 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.044) 0:01:45.440 ********* 2020-04-28T12:45:10.581 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-28T12:45:10.583 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.621 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.045) 0:01:45.486 ********* 2020-04-28T12:45:10.626 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-04-28T12:45:10.627 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.665 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.043) 0:01:45.530 ********* 2020-04-28T12:45:10.670 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-28T12:45:10.672 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.709 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.043) 0:01:45.574 ********* 2020-04-28T12:45:10.714 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:45:10.714 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.753 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.044) 0:01:45.619 ********* 2020-04-28T12:45:10.759 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:45:10.761 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.798 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.044) 0:01:45.663 ********* 2020-04-28T12:45:10.825 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:45:10.826 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.863 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.064) 0:01:45.728 ********* 2020-04-28T12:45:10.891 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:10.946 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:10 +0000 (0:00:00.083) 0:01:45.812 ********* 2020-04-28T12:45:10.973 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:45:10.974 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.013 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.066) 0:01:45.878 ********* 2020-04-28T12:45:11.019 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:45:11.020 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-04-28T12:45:11.070 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.056) 0:01:45.935 ********* 2020-04-28T12:45:11.076 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-28T12:45:11.077 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.122 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.051) 0:01:45.987 ********* 2020-04-28T12:45:11.159 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:11.160 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-28T12:45:11.202 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.080) 0:01:46.067 ********* 2020-04-28T12:45:11.241 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:45:11.245 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.257 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-28T12:45:11.270 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.272 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.285 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.296 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.301 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:45:11.301 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:45:11.362 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.159) 0:01:46.227 ********* 2020-04-28T12:45:11.401 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.038) 0:01:46.266 ********* 2020-04-28T12:45:11.544 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi107.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003542", "end": "2020-04-28 12:45:11.525049", "rc": 0, "start": "2020-04-28 12:45:11.521507", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:45:11.596 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.194) 0:01:46.461 ********* 2020-04-28T12:45:11.602 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:45:11.603 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-04-28T12:45:11.647 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.051) 0:01:46.513 ********* 2020-04-28T12:45:11.654 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-28T12:45:11.655 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.698 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.050) 0:01:46.563 ********* 2020-04-28T12:45:11.710 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.746 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.048) 0:01:46.611 ********* 2020-04-28T12:45:11.750 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-04-28T12:45:11.751 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.791 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.045) 0:01:46.656 ********* 2020-04-28T12:45:11.797 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:45:11.797 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.839 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.048) 0:01:46.705 ********* 2020-04-28T12:45:11.845 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-04-28T12:45:11.846 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.887 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.047) 0:01:46.753 ********* 2020-04-28T12:45:11.894 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-04-28T12:45:11.895 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.940 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.053) 0:01:46.806 ********* 2020-04-28T12:45:11.946 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-28T12:45:11.948 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:11.994 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:11 +0000 (0:00:00.050) 0:01:46.856 ********* 2020-04-28T12:45:12.000 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:45:12.000 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.040 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.048) 0:01:46.905 ********* 2020-04-28T12:45:12.080 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:45:12.082 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.119 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.078) 0:01:46.984 ********* 2020-04-28T12:45:12.145 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:45:12.146 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.185 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.064) 0:01:47.048 ********* 2020-04-28T12:45:12.210 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-04-28T12:45:12.211 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.247 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.063) 0:01:47.112 ********* 2020-04-28T12:45:12.273 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-04-28T12:45:12.274 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.310 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.063) 0:01:47.176 ********* 2020-04-28T12:45:12.347 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-04-28T12:45:12.348 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.384 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.073) 0:01:47.249 ********* 2020-04-28T12:45:12.410 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-04-28T12:45:12.412 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.447 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.063) 0:01:47.313 ********* 2020-04-28T12:45:12.476 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-04-28T12:45:12.477 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.511 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.063) 0:01:47.376 ********* 2020-04-28T12:45:12.537 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-04-28T12:45:12.539 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.574 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.062) 0:01:47.439 ********* 2020-04-28T12:45:12.602 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-04-28T12:45:12.603 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.637 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.063) 0:01:47.503 ********* 2020-04-28T12:45:12.663 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-04-28T12:45:12.665 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.700 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.062) 0:01:47.565 ********* 2020-04-28T12:45:12.726 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-04-28T12:45:12.727 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.763 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.063) 0:01:47.629 ********* 2020-04-28T12:45:12.802 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-04-28T12:45:12.803 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.841 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.077) 0:01:47.706 ********* 2020-04-28T12:45:12.879 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-04-28T12:45:12.880 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:12.929 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.087) 0:01:47.794 ********* 2020-04-28T12:45:12.936 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:45:12.937 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:45:12.980 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:12 +0000 (0:00:00.051) 0:01:47.846 ********* 2020-04-28T12:45:12.987 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-04-28T12:45:12.988 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.028 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.047) 0:01:47.893 ********* 2020-04-28T12:45:13.034 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:45:13.035 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item={u'block_used': 12909663, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185445, u'size_available': 930551582720, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185445, "block_size": 4096, "block_total": 240095108, "block_used": 12909663, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551582720, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}} 2020-04-28T12:45:13.074 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.045) 0:01:47.939 ********* 2020-04-28T12:45:13.078 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-04-28T12:45:13.079 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.117 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.042) 0:01:47.981 ********* 2020-04-28T12:45:13.142 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-04-28T12:45:13.143 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.179 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.062) 0:01:48.044 ********* 2020-04-28T12:45:13.205 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-04-28T12:45:13.207 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.243 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.064) 0:01:48.109 ********* 2020-04-28T12:45:13.272 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-04-28T12:45:13.274 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.275 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:45:13.275 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005034", "end": "2020-04-28 12:45:13.246392", "rc": 0, "start": "2020-04-28 12:45:13.241358", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:13.311 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.067) 0:01:48.176 ********* 2020-04-28T12:45:13.345 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.033) 0:01:48.210 ********* 2020-04-28T12:45:13.349 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:13.349 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-04-28T12:45:13.388 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.043) 0:01:48.254 ********* 2020-04-28T12:45:13.395 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-04-28T12:45:13.396 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'block_used': 12909663, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185445, u'size_available': 930551582720, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185445, "block_size": 4096, "block_total": 240095108, "block_used": 12909663, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551582720, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.435 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.046) 0:01:48.300 ********* 2020-04-28T12:45:13.441 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:45:13.441 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.443 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-04-28T12:45:13.455 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.465 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:45:13.465 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-04-28T12:45:13.466 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.503 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.067) 0:01:48.368 ********* 2020-04-28T12:45:13.509 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.510 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.555 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.052) 0:01:48.420 ********* 2020-04-28T12:45:13.561 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:45:13.563 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0J2', u'wwn-0x5000c50091e2f7f6'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5R0J2', u'wwn': u'0x5000c50091e2f7f6', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0J2-part1', u'wwn-0x5000c50091e2f7f6-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0J2", "wwn-0x5000c50091e2f7f6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0J2-part1", "wwn-0x5000c50091e2f7f6-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R0J2", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:45:13.564 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e2f7f6"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.698 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-04-28T12:45:13.700 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003286", "end": "2020-04-28 12:45:13.680874", "rc": 0, "start": "2020-04-28 12:45:13.677588", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_py2/virtualenv/bin/teuthology-lock"]} 2020-04-28T12:45:13.743 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.184) 0:01:48.605 ********* 2020-04-28T12:45:13.777 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-04-28T12:45:13.779 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.822 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.082) 0:01:48.687 ********* 2020-04-28T12:45:13.855 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.886 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.064) 0:01:48.752 ********* 2020-04-28T12:45:13.913 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:13.950 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:13 +0000 (0:00:00.063) 0:01:48.816 ********* 2020-04-28T12:45:13.976 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-04-28T12:45:13.978 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:14.013 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:14 +0000 (0:00:00.062) 0:01:48.879 ********* 2020-04-28T12:45:15.118 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-04-28T12:45:15.119 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-04-28T12:45:15.120 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:45:15.123 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-wfQn9X-VV5A-X7Kv-TuuO-8PDL-5oUE-060hQh', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400NK400BGN', u'nvme-nvme.8086-504846543632303430304e4b34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.390408", "end": "2020-04-28 12:45:15.088673", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-wfQn9X-VV5A-X7Kv-TuuO-8PDL-5oUE-060hQh", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NK400BGN", "nvme-nvme.8086-504846543632303430304e4b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:13.698265", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:45:15.124 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:15.160 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:15 +0000 (0:00:01.146) 0:01:50.026 ********* 2020-04-28T12:45:15.197 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:45:15.198 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item={u'block_used': 12909677, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185431, u'size_available': 930551525376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989719, u'device': u'/dev/sda1', u'inode_used': 65257, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185431, "block_size": 4096, "block_total": 240095108, "block_used": 12909677, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989719, "inode_total": 61054976, "inode_used": 65257, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551525376, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}} 2020-04-28T12:45:15.237 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:15 +0000 (0:00:00.076) 0:01:50.103 ********* 2020-04-28T12:45:15.453 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-04-28T12:45:15.455 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005515", "end": "2020-04-28 12:45:15.422931", "rc": 0, "start": "2020-04-28 12:45:15.417416", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:15.498 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:15 +0000 (0:00:00.260) 0:01:50.363 ********* 2020-04-28T12:45:15.546 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi026.front.sepia.ceph.com] => (item={u'block_used': 12909677, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185431, u'size_available': 930551525376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989719, u'device': u'/dev/sda1', u'inode_used': 65257, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185431, "block_size": 4096, "block_total": 240095108, "block_used": 12909677, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989719, "inode_total": 61054976, "inode_used": 65257, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551525376, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:15.586 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:15 +0000 (0:00:00.087) 0:01:50.451 ********* 2020-04-28T12:45:15.612 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-04-28T12:45:15.652 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:15 +0000 (0:00:00.066) 0:01:50.517 ********* 2020-04-28T12:45:15.711 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:45:15.711 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3KL', u'wwn-0x5000c500871b4821'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4H3KL', u'wwn': u'0x5000c500871b4821', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1', u'wwn-0x5000c500871b4821-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL", "wwn-0x5000c500871b4821"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1", "wwn-0x5000c500871b4821-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4H3KL", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:45:15.713 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871b4821"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:16.358 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFEFM3ImFlsKBhiMj0uYAH5pKsqljoMS4v'], u'uuids': [u'ee5e4ee6-f10c-469e-a47c-68baf426a973']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.042637", "end": "2020-04-28 12:45:16.327696", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFEFM3ImFlsKBhiMj0uYAH5pKsqljoMS4v"], "labels": [], "masters": [], "uuids": ["ee5e4ee6-f10c-469e-a47c-68baf426a973"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:15.285059", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:17.227 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-3UYeHq-nLKc-MJNY-GL6Y-RB7l-aX0A-WhIh7E', u'nvme-INTEL_SSDPEDMD400G4_CVFT5331003G400BGN', u'nvme-nvme.8086-43564654353333313030334734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.318108", "end": "2020-04-28 12:45:17.194536", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-3UYeHq-nLKc-MJNY-GL6Y-RB7l-aX0A-WhIh7E", "nvme-INTEL_SSDPEDMD400G4_CVFT5331003G400BGN", "nvme-nvme.8086-43564654353333313030334734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:15.876428", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-04-28T12:45:17.229 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:17.617 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFKGwk3125IqZjSkd80YeeAtYOuYC9jlCy'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.061771", "end": "2020-04-28 12:45:17.580775", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFKGwk3125IqZjSkd80YeeAtYOuYC9jlCy"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:16.519004", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:18.505 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgwVoSDBizE80m9YA47P00apVEkBVOh0q8'], u'uuids': [u'092de440-bade-4387-8665-bfc013d820f0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.065532", "end": "2020-04-28 12:45:18.470467", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgwVoSDBizE80m9YA47P00apVEkBVOh0q8"], "labels": [], "masters": [], "uuids": ["092de440-bade-4387-8665-bfc013d820f0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:17.404935", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:18.862 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFX3RVKo4IQf7Y84VwAhgC3Osn7htHvMEW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.046767", "end": "2020-04-28 12:45:18.828259", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFX3RVKo4IQf7Y84VwAhgC3Osn7htHvMEW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:17.781492", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:19.765 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgjsdPho2AcR3qrnlVIjyTUC79b2WcPG9z'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.048934", "end": "2020-04-28 12:45:19.728264", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgjsdPho2AcR3qrnlVIjyTUC79b2WcPG9z"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:18.679330", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:20.124 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWpqSMmkbFcrRBVDpWieinzGrfHmpxKLl'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.065358", "end": "2020-04-28 12:45:20.089330", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWpqSMmkbFcrRBVDpWieinzGrfHmpxKLl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:19.023972", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:21.049 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgVAGtBycVadeZ12rvQaSqXBwRKSovO59d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.080434", "end": "2020-04-28 12:45:21.017076", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgVAGtBycVadeZ12rvQaSqXBwRKSovO59d"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:19.936642", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:21.379 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWfPdyjuZQ3gJczsHcNjrB5JAaxYVE3ky'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.048144", "end": "2020-04-28 12:45:21.344766", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWfPdyjuZQ3gJczsHcNjrB5JAaxYVE3ky"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:20.296622", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:21.441 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:21 +0000 (0:00:05.788) 0:01:56.306 ********* 2020-04-28T12:45:21.495 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:45:21.497 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0J2', u'wwn-0x5000c50091e2f7f6'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5R0J2', u'wwn': u'0x5000c50091e2f7f6', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5R0J2-part1', u'wwn-0x5000c50091e2f7f6-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0J2", "wwn-0x5000c50091e2f7f6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5R0J2-part1", "wwn-0x5000c50091e2f7f6-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5R0J2", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:45:21.498 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e2f7f6"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:21.745 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-wfQn9X-VV5A-X7Kv-TuuO-8PDL-5oUE-060hQh', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400NK400BGN', u'nvme-nvme.8086-504846543632303430304e4b34303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037602", "end": "2020-04-28 12:45:21.708293", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-wfQn9X-VV5A-X7Kv-TuuO-8PDL-5oUE-060hQh", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NK400BGN", "nvme-nvme.8086-504846543632303430304e4b34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:21.670691", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:45:21.747 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0349189 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349189 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:22.088 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFEFM3ImFlsKBhiMj0uYAH5pKsqljoMS4v'], u'uuids': [u'ee5e4ee6-f10c-469e-a47c-68baf426a973']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.145332", "end": "2020-04-28 12:45:22.057018", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFEFM3ImFlsKBhiMj0uYAH5pKsqljoMS4v"], "labels": [], "masters": [], "uuids": ["ee5e4ee6-f10c-469e-a47c-68baf426a973"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:21.911686", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142705 s, 808 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142705 s, 808 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:22.309 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg1MK2u9MdeKrIJqJs2cJQ43gd3cJxJcS0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.054598", "end": "2020-04-28 12:45:22.270613", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg1MK2u9MdeKrIJqJs2cJQ43gd3cJxJcS0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:21.216015", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:22.419 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFKGwk3125IqZjSkd80YeeAtYOuYC9jlCy'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141321", "end": "2020-04-28 12:45:22.386160", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFKGwk3125IqZjSkd80YeeAtYOuYC9jlCy"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:22.244839", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138775 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138775 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:22.751 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFX3RVKo4IQf7Y84VwAhgC3Osn7htHvMEW'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139301", "end": "2020-04-28 12:45:22.717871", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFX3RVKo4IQf7Y84VwAhgC3Osn7htHvMEW"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:22.578570", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136632 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136632 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:23.079 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWpqSMmkbFcrRBVDpWieinzGrfHmpxKLl'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.140910", "end": "2020-04-28 12:45:23.044902", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWpqSMmkbFcrRBVDpWieinzGrfHmpxKLl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:22.903992", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138288 s, 834 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138288 s, 834 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:23.405 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWfPdyjuZQ3gJczsHcNjrB5JAaxYVE3ky'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139902", "end": "2020-04-28 12:45:23.370770", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DxK2bB3DdaCFsKSnsSSprtyzT1jd8TsFWfPdyjuZQ3gJczsHcNjrB5JAaxYVE3ky"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:23.230868", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137388 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137388 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:23.457 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:23 +0000 (0:00:02.015) 0:01:58.322 ********* 2020-04-28T12:45:23.572 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-04-28T12:45:23.573 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg5x1FsdUsCXNxNgfn9QSaE0yUjsQMFGqh'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.055149", "end": "2020-04-28 12:45:23.530581", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg5x1FsdUsCXNxNgfn9QSaE0yUjsQMFGqh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:22.475432", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-04-28T12:45:23.631 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:23 +0000 (0:00:00.173) 0:01:58.496 ********* 2020-04-28T12:45:23.679 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:45:23.680 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3KL', u'wwn-0x5000c500871b4821'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4H3KL', u'wwn': u'0x5000c500871b4821', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1', u'wwn-0x5000c500871b4821-part1'], u'uuids': [u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL", "wwn-0x5000c500871b4821"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H3KL-part1", "wwn-0x5000c500871b4821-part1"], "labels": [], "masters": [], "uuids": ["7620f5f6-1f50-4a4b-b151-01e62dd49ff9"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4H3KL", "size": "931.51 GB", "support_discard": "0", "vend 2020-04-28T12:45:23.681 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c500871b4821"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:23.723 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-28T12:45:23.726 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.053388", "end": "2020-04-28 12:45:23.681080", "rc": 0, "start": "2020-04-28 12:45:23.627692", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:23.761 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:23 +0000 (0:00:00.130) 0:01:58.626 ********* 2020-04-28T12:45:23.931 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:45:23.933 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-3UYeHq-nLKc-MJNY-GL6Y-RB7l-aX0A-WhIh7E', u'nvme-INTEL_SSDPEDMD400G4_CVFT5331003G400BGN', u'nvme-nvme.8086-43564654353333313030334734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_2', u'vg_nvme-lv_5', u'vg_nvme-lv_3', u'vg_nvme-lv_1', u'vg_nvme-lv_4'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036769", "end": "2020-04-28 12:45:23.901097", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-3UYeHq-nLKc-MJNY-GL6Y-RB7l-aX0A-WhIh7E", "nvme-INTEL_SSDPEDMD400G4_CVFT5331003G400BGN", "nvme-nvme.8086-43564654353333313030334734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:23.864328", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-04-28T12:45:23.934 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0339648 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0339648 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:24.003 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-28T12:45:24.004 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.043464", "end": "2020-04-28 12:45:23.974023", "rc": 0, "start": "2020-04-28 12:45:23.930559", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:24.050 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.288) 0:01:58.915 ********* 2020-04-28T12:45:24.076 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:45:24.117 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.067) 0:01:58.982 ********* 2020-04-28T12:45:24.160 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-28T12:45:24.161 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.203 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.085) 0:01:59.068 ********* 2020-04-28T12:45:24.239 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-28T12:45:24.241 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.282 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.078) 0:01:59.147 ********* 2020-04-28T12:45:24.288 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:45:24.289 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgwVoSDBizE80m9YA47P00apVEkBVOh0q8'], u'uuids': [u'092de440-bade-4387-8665-bfc013d820f0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.137985", "end": "2020-04-28 12:45:24.236033", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgwVoSDBizE80m9YA47P00apVEkBVOh0q8"], "labels": [], "masters": [], "uuids": ["092de440-bade-4387-8665-bfc013d820f0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:24.098048", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135199 s, 853 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135199 s, 853 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:24.312 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:45:24.314 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.356 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.074) 0:01:59.221 ********* 2020-04-28T12:45:24.385 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.430 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.069) 0:01:59.290 ********* 2020-04-28T12:45:24.602 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:45:24.603 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgjsdPho2AcR3qrnlVIjyTUC79b2WcPG9z'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.145032", "end": "2020-04-28 12:45:24.572686", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgjsdPho2AcR3qrnlVIjyTUC79b2WcPG9z"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:24.427654", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.142403 s, 810 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.142403 s, 810 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:24.636 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-04-28T12:45:24.637 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:45:24.686 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.260) 0:01:59.551 ********* 2020-04-28T12:45:24.735 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:45:24.736 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={u'block_used': 12909663, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185445, u'size_available': 930551582720, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989723, u'device': u'/dev/sda1', u'inode_used': 65253, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185445, "block_size": 4096, "block_total": 240095108, "block_used": 12909663, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989723, "inode_total": 61054976, "inode_used": 65253, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551582720, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.776 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.089) 0:01:59.641 ********* 2020-04-28T12:45:24.803 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.843 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.066) 0:01:59.708 ********* 2020-04-28T12:45:24.869 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:24.870 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.872 INFO:teuthology.task.ansible.out: 2020-04-28T12:45:24.908 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.064) 0:01:59.773 ********* 2020-04-28T12:45:24.944 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:45:24.945 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgVAGtBycVadeZ12rvQaSqXBwRKSovO59d'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.136598", "end": "2020-04-28 12:45:24.903205", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8MgVAGtBycVadeZ12rvQaSqXBwRKSovO59d"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:24.766607", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.133804 s, 862 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.133804 s, 862 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:24.946 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:24.983 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:24 +0000 (0:00:00.075) 0:01:59.848 ********* 2020-04-28T12:45:25.011 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-28T12:45:25.013 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:25.047 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:25 +0000 (0:00:00.063) 0:01:59.912 ********* 2020-04-28T12:45:25.083 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-28T12:45:25.084 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:25.122 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:25 +0000 (0:00:00.072) 0:01:59.985 ********* 2020-04-28T12:45:25.147 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:25.185 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:25 +0000 (0:00:00.062) 0:02:00.047 ********* 2020-04-28T12:45:25.288 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-04-28T12:45:25.288 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg1MK2u9MdeKrIJqJs2cJQ43gd3cJxJcS0'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.138833", "end": "2020-04-28 12:45:25.248697", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg1MK2u9MdeKrIJqJs2cJQ43gd3cJxJcS0"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:25.109864", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136087 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136087 s, 848 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:25.619 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg5x1FsdUsCXNxNgfn9QSaE0yUjsQMFGqh'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.137638", "end": "2020-04-28 12:45:25.591485", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Y6HDtOcxrGu3t2d1RmYVSxqyaXEvv8Mg5x1FsdUsCXNxNgfn9QSaE0yUjsQMFGqh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-04-28 12:45:25.453847", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.134817 s, 856 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.134817 s, 856 MB/s"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:25.675 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:25 +0000 (0:00:00.493) 0:02:00.540 ********* 2020-04-28T12:45:25.894 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:45:25.931 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:25 +0000 (0:00:00.255) 0:02:00.796 ********* 2020-04-28T12:45:25.948 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-04-28T12:45:25.948 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.065924", "end": "2020-04-28 12:45:25.918794", "rc": 0, "start": "2020-04-28 12:45:25.852870", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:25.985 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:25 +0000 (0:00:00.053) 0:02:00.850 ********* 2020-04-28T12:45:26.240 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-04-28T12:45:26.241 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.040645", "end": "2020-04-28 12:45:26.203631", "rc": 0, "start": "2020-04-28 12:45:26.162986", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:26.278 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:26 +0000 (0:00:00.292) 0:02:01.143 ********* 2020-04-28T12:45:26.316 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-04-28T12:45:26.361 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:26 +0000 (0:00:00.083) 0:02:01.227 ********* 2020-04-28T12:45:26.388 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-04-28T12:45:26.389 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:26.429 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:26 +0000 (0:00:00.067) 0:02:01.294 ********* 2020-04-28T12:45:26.456 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-04-28T12:45:26.458 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:26.497 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:26 +0000 (0:00:00.067) 0:02:01.362 ********* 2020-04-28T12:45:26.535 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:45:26.536 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:26.580 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:26 +0000 (0:00:00.082) 0:02:01.445 ********* 2020-04-28T12:45:26.586 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:26.587 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:26.619 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:26.651 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:26 +0000 (0:00:00.071) 0:02:01.516 ********* 2020-04-28T12:45:26.881 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-04-28T12:45:26.919 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:26 +0000 (0:00:00.268) 0:02:01.784 ********* 2020-04-28T12:45:26.927 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:26.927 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:26.964 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-04-28T12:45:26.964 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={u'block_used': 12909677, u'uuid': u'7620f5f6-1f50-4a4b-b151-01e62dd49ff9', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227185431, u'size_available': 930551525376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989719, u'device': u'/dev/sda1', u'inode_used': 65257, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227185431, "block_size": 4096, "block_total": 240095108, "block_used": 12909677, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989719, "inode_total": 61054976, "inode_used": 65257, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930551525376, "size_total": 983429562368, "uuid": "7620f5f6-1f50-4a4b-b151-01e62dd49ff9"}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:27.004 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.084) 0:02:01.869 ********* 2020-04-28T12:45:27.032 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:27.072 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.067) 0:02:01.937 ********* 2020-04-28T12:45:27.117 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:27.154 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.081) 0:02:02.019 ********* 2020-04-28T12:45:27.180 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:27.182 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:27.217 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.064) 0:02:02.083 ********* 2020-04-28T12:45:27.255 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-04-28T12:45:27.257 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:27.301 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.083) 0:02:02.166 ********* 2020-04-28T12:45:27.309 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:27.309 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:27.342 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-04-28T12:45:27.344 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:27.392 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.090) 0:02:02.257 ********* 2020-04-28T12:45:27.418 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-04-28T12:45:27.420 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:27.459 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.067) 0:02:02.325 ********* 2020-04-28T12:45:27.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:27.650 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:27.931 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-04-28T12:45:27.933 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-04-28T12:45:27.974 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:27 +0000 (0:00:00.514) 0:02:02.839 ********* 2020-04-28T12:45:27.990 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:27.991 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:28.063 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:28 +0000 (0:00:00.088) 0:02:02.928 ********* 2020-04-28T12:45:28.258 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:45:28.259 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:45:28.307 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:28 +0000 (0:00:00.242) 0:02:03.170 ********* 2020-04-28T12:45:28.352 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-28T12:45:28.354 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:28.364 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:28.366 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:28.532 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:28.719 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:28.721 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-28T12:45:28.721 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:28.917 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:29.104 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:29.105 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi107.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:29.180 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:29 +0000 (0:00:00.875) 0:02:04.045 ********* 2020-04-28T12:45:29.390 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-28T12:45:29.392 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:45:29.433 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:29 +0000 (0:00:00.252) 0:02:04.298 ********* 2020-04-28T12:45:29.470 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-28T12:45:29.472 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:45:29.538 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:29 +0000 (0:00:00.105) 0:02:04.403 ********* 2020-04-28T12:45:29.544 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-04-28T12:45:29.545 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:29.841 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-04-28T12:45:29.879 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:29 +0000 (0:00:00.341) 0:02:04.744 ********* 2020-04-28T12:45:30.086 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-04-28T12:45:30.087 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-04-28T12:45:30.122 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:30 +0000 (0:00:00.242) 0:02:04.987 ********* 2020-04-28T12:45:30.181 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-04-28T12:45:30.182 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:30.372 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:30.570 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:30.769 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:30.969 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-04-28T12:45:31.019 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.896) 0:02:05.884 ********* 2020-04-28T12:45:31.140 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-04-28T12:45:31.142 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true} 2020-04-28T12:45:31.193 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.174) 0:02:06.058 ********* 2020-04-28T12:45:31.253 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-04-28T12:45:31.254 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-04-28T12:45:31.293 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.099) 0:02:06.158 ********* 2020-04-28T12:45:31.332 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-04-28T12:45:31.332 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-04-28T12:45:31.373 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.079) 0:02:06.238 ********* 2020-04-28T12:45:31.687 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi026.front.sepia.ceph.com] => {"changed": true} 2020-04-28T12:45:31.726 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.353) 0:02:06.592 ********* 2020-04-28T12:45:31.817 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:45:31.819 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:45:31.858 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.129) 0:02:06.722 ********* 2020-04-28T12:45:31.890 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:45:31.892 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:31.929 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.072) 0:02:06.794 ********* 2020-04-28T12:45:31.955 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-28T12:45:31.957 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:31.995 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:31 +0000 (0:00:00.064) 0:02:06.858 ********* 2020-04-28T12:45:32.022 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:45:32.024 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.063 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.067) 0:02:06.926 ********* 2020-04-28T12:45:32.066 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-04-28T12:45:32.067 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-04-28T12:45:32.114 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.045) 0:02:06.972 ********* TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.153 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.046) 0:02:07.019 ********* 2020-04-28T12:45:32.158 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-04-28T12:45:32.161 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.199 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.045) 0:02:07.064 ********* 2020-04-28T12:45:32.205 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-28T12:45:32.207 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.246 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.047) 0:02:07.112 ********* 2020-04-28T12:45:32.252 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-04-28T12:45:32.253 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.306 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.048) 0:02:07.160 ********* TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.343 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.047) 0:02:07.208 ********* 2020-04-28T12:45:32.348 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-04-28T12:45:32.349 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.387 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.044) 0:02:07.252 ********* 2020-04-28T12:45:32.397 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-28T12:45:32.398 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.437 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.049) 0:02:07.302 ********* 2020-04-28T12:45:32.448 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.483 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.045) 0:02:07.348 ********* 2020-04-28T12:45:32.488 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-04-28T12:45:32.489 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.529 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.046) 0:02:07.394 ********* 2020-04-28T12:45:32.535 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-04-28T12:45:32.537 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.582 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.046) 0:02:07.441 ********* TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.641 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.061) 0:02:07.503 ********* 2020-04-28T12:45:32.647 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-04-28T12:45:32.652 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.691 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.053) 0:02:07.556 ********* 2020-04-28T12:45:32.697 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:45:32.701 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.736 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.044) 0:02:07.601 ********* 2020-04-28T12:45:32.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-04-28T12:45:32.742 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.781 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.045) 0:02:07.646 ********* 2020-04-28T12:45:32.787 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:45:32.788 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.825 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.043) 0:02:07.690 ********* 2020-04-28T12:45:32.832 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.872 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.046) 0:02:07.737 ********* 2020-04-28T12:45:32.898 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-04-28T12:45:32.899 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.935 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.063) 0:02:07.800 ********* 2020-04-28T12:45:32.961 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-04-28T12:45:32.962 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:32.997 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:32 +0000 (0:00:00.062) 0:02:07.862 ********* 2020-04-28T12:45:33.025 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-04-28T12:45:33.026 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:33.064 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:33 +0000 (0:00:00.065) 0:02:07.927 ********* 2020-04-28T12:45:33.318 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-04-28T12:45:33.318 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:45:33.355 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:33 +0000 (0:00:00.292) 0:02:08.220 ********* 2020-04-28T12:45:33.592 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-04-28T12:45:33.639 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:33 +0000 (0:00:00.283) 0:02:08.504 ********* 2020-04-28T12:45:33.675 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-28T12:45:33.679 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:41:56 UTC", "ActiveEnterTimestampMonotonic": "14649327", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpdate.service -.mount sntp.service ntpd.service systemd-tmpfiles-setup.service sysinit.target basic.target systemd-journald.socket tmp.mount system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:41:54 UTC", "AssertTimestampMonotonic": "13254298", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:41:54 UTC", "ConditionTimestampMonotonic": "13254273", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-28T12:45:33.680 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2397", "ExecMainStartTimestamp": "Tue 2020-04-28 12:41:55 UTC", "ExecMainStartTimestampMonotonic": "13573487", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:41:54 UTC", "InactiveExitTimestampMonotonic": "13275288", "InvocationID": "506bc4f142c1440aa6f79491dbd182dd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-28T12:45:33.682 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127442", "LimitNPROCSoft": "127442", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127442", "LimitSIGPENDINGSoft": "127442", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2397", "MemoryAccounting": "yes", "MemoryCurrent": "3018752", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-28T12:45:33.683 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:41:56 UTC", "StateChangeTimestampMonotonic": "14649327", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:41:55 UTC", "WatchdogTimestampMonotonic": "13573501", "WatchdogUSec": "0"}} 2020-04-28T12:45:33.721 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:33 +0000 (0:00:00.082) 0:02:08.587 ********* 2020-04-28T12:45:33.748 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:33.749 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:45:33.796 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:33 +0000 (0:00:00.074) 0:02:08.662 ********* 2020-04-28T12:45:33.834 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:33.836 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:45:33.872 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:33 +0000 (0:00:00.075) 0:02:08.737 ********* 2020-04-28T12:45:33.900 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-04-28T12:45:33.902 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:33.938 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:33 +0000 (0:00:00.066) 0:02:08.803 ********* 2020-04-28T12:45:33.966 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-04-28T12:45:33.968 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Tue 2020-04-28 12:42:13 UTC", "ActiveEnterTimestampMonotonic": "14149076", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount systemd-journald.socket systemd-tmpfiles-setup.service ntpd.service sntp.service basic.target -.mount sysinit.target system.slice ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Tue 2020-04-28 12:42:12 UTC", "AssertTimestampMonotonic": "12709263", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Tue 2020-04-28 12:42:12 UTC", "ConditionTimestampMonotonic": "12709234", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-04-28T12:45:33.973 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2128", "ExecMainStartTimestamp": "Tue 2020-04-28 12:42:12 UTC", "ExecMainStartTimestampMonotonic": "12942945", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Tue 2020-04-28 12:42:12 UTC", "InactiveExitTimestampMonotonic": "12760310", "InvocationID": "dc5b607a22ff43af939a32a49e20cf60", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-04-28T12:45:33.974 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127467", "LimitNPROCSoft": "127467", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127467", "LimitSIGPENDINGSoft": "127467", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2128", "MemoryAccounting": "yes", "MemoryCurrent": "2891776", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-04-28T12:45:33.976 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Tue 2020-04-28 12:42:13 UTC", "StateChangeTimestampMonotonic": "14149076", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type 2020-04-28T12:45:33.976 INFO:teuthology.task.ansible.out:": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Tue 2020-04-28 12:42:12 UTC", "WatchdogTimestampMonotonic": "12942962", "WatchdogUSec": "0"}} 2020-04-28T12:45:33.978 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-28T12:45:33.980 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:34.015 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.077) 0:02:08.881 ********* 2020-04-28T12:45:34.053 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.035) 0:02:08.916 ********* 2020-04-28T12:45:34.058 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:34.062 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-04-28T12:45:34.098 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.046) 0:02:08.963 ********* 2020-04-28T12:45:34.103 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:45:34.105 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:34.143 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.045) 0:02:09.008 ********* 2020-04-28T12:45:34.151 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:34.153 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-04-28T12:45:34.189 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.046) 0:02:09.055 ********* 2020-04-28T12:45:34.217 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:34.258 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.068) 0:02:09.123 ********* 2020-04-28T12:45:34.293 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-04-28T12:45:34.293 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:34.334 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.075) 0:02:09.199 ********* 2020-04-28T12:45:34.359 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:45:34.393 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.058) 0:02:09.258 ********* 2020-04-28T12:45:34.394 INFO:teuthology.task.ansible.out: 2020-04-28T12:45:34.398 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-04-28T12:45:34.399 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:34.447 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.054) 0:02:09.312 ********* 2020-04-28T12:45:34.684 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-04-28T12:45:34.725 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.277) 0:02:09.590 ********* 2020-04-28T12:45:34.886 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-04-28T12:45:34.887 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:45:34.943 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:34 +0000 (0:00:00.218) 0:02:09.808 ********* 2020-04-28T12:45:35.277 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1214, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-04-28T12:45:35.314 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:35 +0000 (0:00:00.370) 0:02:10.179 ********* 2020-04-28T12:45:36.286 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-28T12:45:36.287 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:45:36.332 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:01.018) 0:02:11.198 ********* 2020-04-28T12:45:36.370 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-28T12:45:36.371 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:36.410 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.077) 0:02:11.275 ********* 2020-04-28T12:45:36.427 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-04-28T12:45:36.427 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-04-28T12:45:36.475 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.064) 0:02:11.340 ********* 2020-04-28T12:45:36.482 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-04-28T12:45:36.483 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-04-28T12:45:36.537 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.059) 0:02:11.400 ********* 2020-04-28T12:45:36.541 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-04-28T12:45:36.542 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:36.588 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.053) 0:02:11.453 ********* 2020-04-28T12:45:36.620 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-04-28T12:45:36.660 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.072) 0:02:11.525 ********* 2020-04-28T12:45:36.728 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-28T12:45:36.730 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:45:36.766 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.105) 0:02:11.631 ********* 2020-04-28T12:45:36.803 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-04-28T12:45:36.804 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:36.846 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.079) 0:02:11.710 ********* 2020-04-28T12:45:36.883 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-28T12:45:36.885 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:45:36.930 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.077) 0:02:11.788 ********* 2020-04-28T12:45:36.932 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-04-28T12:45:36.932 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-04-28T12:45:36.974 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:36 +0000 (0:00:00.051) 0:02:11.840 ********* 2020-04-28T12:45:36.983 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.020 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.045) 0:02:11.885 ********* 2020-04-28T12:45:37.030 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.064 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.044) 0:02:11.929 ********* 2020-04-28T12:45:37.101 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-04-28T12:45:37.102 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-04-28T12:45:37.146 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.075) 0:02:12.005 ********* 2020-04-28T12:45:37.176 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-04-28T12:45:37.178 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.214 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.074) 0:02:12.079 ********* 2020-04-28T12:45:37.231 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-04-28T12:45:37.232 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:45:37.271 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.056) 0:02:12.136 ********* 2020-04-28T12:45:37.435 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-04-28T12:45:37.476 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.205) 0:02:12.341 ********* 2020-04-28T12:45:37.483 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-28T12:45:37.483 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:45:37.529 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.047) 0:02:12.391 ********* 2020-04-28T12:45:37.552 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-04-28T12:45:37.554 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.594 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.068) 0:02:12.459 ********* 2020-04-28T12:45:37.632 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-28T12:45:37.633 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.645 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.650 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi107.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.692 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.098) 0:02:12.557 ********* 2020-04-28T12:45:37.701 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-04-28T12:45:37.702 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-04-28T12:45:37.769 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.075) 0:02:12.633 ********* 2020-04-28T12:45:37.774 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi107.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.777 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.778 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.780 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.781 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.823 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.055) 0:02:12.688 ********* 2020-04-28T12:45:37.833 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.869 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.045) 0:02:12.734 ********* 2020-04-28T12:45:37.875 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:37.875 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.925 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.055) 0:02:12.790 ********* 2020-04-28T12:45:37.930 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-04-28T12:45:37.932 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.932 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.934 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-04-28T12:45:37.974 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:37 +0000 (0:00:00.049) 0:02:12.840 ********* 2020-04-28T12:45:37.980 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-04-28T12:45:37.982 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.034 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.059) 0:02:12.899 ********* 2020-04-28T12:45:38.041 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi026.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.042 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.044 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi026.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.045 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.087 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.053) 0:02:12.952 ********* 2020-04-28T12:45:38.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.142 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.054) 0:02:13.007 ********* 2020-04-28T12:45:38.148 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-04-28T12:45:38.150 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.200 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.058) 0:02:13.065 ********* 2020-04-28T12:45:38.207 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:45:38.208 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.249 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.048) 0:02:13.114 ********* 2020-04-28T12:45:38.258 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.295 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.046) 0:02:13.161 ********* 2020-04-28T12:45:38.302 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-28T12:45:38.302 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.348 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.047) 0:02:13.208 ********* 2020-04-28T12:45:38.349 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.390 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.047) 0:02:13.255 ********* 2020-04-28T12:45:38.400 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.438 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.046) 0:02:13.302 ********* 2020-04-28T12:45:38.442 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-04-28T12:45:38.446 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.486 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.049) 0:02:13.351 ********* 2020-04-28T12:45:38.492 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-28T12:45:38.493 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.532 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.045) 0:02:13.397 ********* 2020-04-28T12:45:38.537 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-04-28T12:45:38.539 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.589 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.057) 0:02:13.455 ********* 2020-04-28T12:45:38.595 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:45:38.597 INFO:teuthology.task.ansible.out:skipping: [smithi107.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.633 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.043) 0:02:13.498 ********* 2020-04-28T12:45:38.638 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-04-28T12:45:38.640 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.681 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.047) 0:02:13.546 ********* 2020-04-28T12:45:38.708 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-04-28T12:45:38.710 INFO:teuthology.task.ansible.out:skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.750 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.066) 0:02:13.613 ********* 2020-04-28T12:45:38.800 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi026.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-04-28T12:45:38.834 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:38 +0000 (0:00:00.086) 0:02:13.699 ********* 2020-04-28T12:45:39.077 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:45:39.078 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005685", "end": "2020-04-28 12:45:39.033550", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:45:39.027865", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:39.280 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003261", "end": "2020-04-28 12:45:39.243178", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:45:39.239917", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:39.488 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002870", "end": "2020-04-28 12:45:39.443959", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:45:39.441089", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:39.696 INFO:teuthology.task.ansible.out:ok: [smithi026.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.022396", "end": "2020-04-28 12:45:39.661368", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:45:39.638972", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:39.748 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:39 +0000 (0:00:00.912) 0:02:14.611 ********* 2020-04-28T12:45:39.774 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-28T12:45:39.816 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:39 +0000 (0:00:00.069) 0:02:14.681 ********* 2020-04-28T12:45:39.874 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:45:39.874 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.005942", "end": "2020-04-28 12:45:39.823120", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-04-28 12:45:38.817178", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:40.034 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-28T12:45:40.035 INFO:teuthology.task.ansible.out:changed: [smithi026.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:45:41.066 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-04-28T12:45:41.068 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:01.004020", "end": "2020-04-28 12:45:41.030232", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-04-28 12:45:40.026212", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:41.284 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002788", "end": "2020-04-28 12:45:41.234963", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-04-28 12:45:41.232175", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:41.482 INFO:teuthology.task.ansible.out:ok: [smithi107.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.018319", "end": "2020-04-28 12:45:41.443729", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-04-28 12:45:41.425410", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-04-28T12:45:41.519 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:41 +0000 (0:00:01.703) 0:02:16.384 ********* 2020-04-28T12:45:41.545 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-04-28T12:45:41.587 INFO:teuthology.task.ansible.out:Tuesday 28 April 2020 12:45:41 +0000 (0:00:00.066) 0:02:16.451 ********* 2020-04-28T12:45:41.790 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-04-28T12:45:41.791 INFO:teuthology.task.ansible.out:changed: [smithi107.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-04-28T12:45:41.905 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-04-28T12:45:41.907 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-04-28T12:45:41.909 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-04-28T12:45:41.911 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi026.front.sepia.ceph.com : ok=113 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi107.front.sepia.ceph.com : ok=113 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Tuesday 28 April 2020 12:45:41 +0000 (0:00:00.323) 0:02:16.775 ********* =============================================================================== 2020-04-28T12:45:41.911 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 16.31s common : nrpe - Load SELinux policy package ---------------------------- 15.51s testnode : Zap all non-root disks --------------------------------------- 5.79s testnode : Install packages --------------------------------------------- 5.77s testnode : Base group workaround for BZ1782899 -------------------------- 3.18s 2020-04-28T12:45:41.911 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 1.53s testnode : Ensure ceph dependency packages are not present. ------------- 1.47s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.40s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.25s common : Install Kerberos Packages (RedHat) ----------------------------- 1.15s testnode : Make sure rpm dependencies are installed --------------------- 1.15s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.09s 2020-04-28T12:45:41.911 INFO:teuthology.task.ansible.out:ansible-managed : Add authorized keys for the ansible user. ------------- 1.02s testnode : Install packages via pip ------------------------------------- 1.02s 2020-04-28T12:45:41.912 INFO:teuthology.task.ansible.out:common : Make sure smartmontools is installed --------------------------- 0.94s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.93s users : Create all admin users with sudo access. ------------------------ 0.91s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.91s common : Config 2020-04-28T12:45:41.913 INFO:teuthology.task.ansible.out:ure local epel mirrorlists ------------------------------- 0.90s common : nrpe - Install SELinux dependencies ---------------------------- 0.90s 2020-04-28T12:45:42.208 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2020-04-28T12:45:42.211 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:45:42.212 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi026.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:45:42.344 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:42.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-04-28T12:45:42.447 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi107.front.sepia.ceph.com', 'timeout': 60} 2020-04-28T12:45:42.518 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:42.606 INFO:teuthology.run_tasks:Running task clock... 2020-04-28T12:45:42.616 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-04-28T12:45:42.617 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:42.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:45:42.634 INFO:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:45:42.741 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:45:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:45:42.808 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2020-04-28T12:45:42.841 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:45:42.843 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2020-04-28T12:45:42.860 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:45:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2020-04-28T12:45:42.963 INFO:teuthology.orchestra.run.smithi026.stdout:210 Number of sources = 4 2020-04-28T12:45:42.964 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:45:42.964 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2020-04-28T12:45:42.964 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:42.964 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:42.964 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:42.964 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:42.965 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:42.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2020-04-28T12:45:42.979 INFO:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-04-28T12:45:43.064 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-04-28T12:45:43.074 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-04-28T12:45:43.143 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2020-04-28T12:45:43.146 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-04-28T12:45:43.161 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2020-04-28T12:45:43.163 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-04-28T12:45:43.278 INFO:teuthology.orchestra.run.smithi107.stdout:210 Number of sources = 4 2020-04-28T12:45:43.278 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-04-28T12:45:43.278 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2020-04-28T12:45:43.279 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:43.279 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:43.279 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:43.279 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-04-28T12:45:43.280 INFO:teuthology.orchestra.run.smithi107.stderr:bash: ntpq: command not found 2020-04-28T12:45:43.281 INFO:teuthology.run_tasks:Running task install... 2020-04-28T12:45:43.291 DEBUG:teuthology.task.install:project ceph 2020-04-28T12:45:43.291 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}} 2020-04-28T12:45:43.291 DEBUG:teuthology.task.install:config {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:45:43.291 INFO:teuthology.task.install:Using flavor: basic 2020-04-28T12:45:43.298 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-04-28T12:45:43.299 INFO:teuthology.task.install:extra packages: [] 2020-04-28T12:45:43.299 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:43.313 INFO:teuthology.orchestra.run.smithi026:> sudo lsb_release -is 2020-04-28T12:45:43.398 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS 2020-04-28T12:45:43.399 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:45:43.400 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:43.400 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:45:43.401 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:43.414 INFO:teuthology.orchestra.run.smithi107:> sudo lsb_release -is 2020-04-28T12:45:43.454 INFO:teuthology.orchestra.run.smithi026:> sudo lsb_release -is 2020-04-28T12:45:43.490 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS 2020-04-28T12:45:43.491 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:45:43.491 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'basic', 'extras': None} 2020-04-28T12:45:43.491 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:43.533 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS 2020-04-28T12:45:43.534 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:45:43.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:45:43.560 INFO:teuthology.orchestra.run.smithi107:> sudo lsb_release -is 2020-04-28T12:45:43.638 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS 2020-04-28T12:45:43.639 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:45:43.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:45:43.799 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:45:43.800 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:45:43.871 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/ 2020-04-28T12:45:43.872 INFO:teuthology.task.install.rpm:Package version is 15.2.1-136.ga8c125c7d7 2020-04-28T12:45:43.982 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:45:43.983 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:43.998 INFO:teuthology.orchestra.run.smithi026:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:45:44.048 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/octopus/a8c125c7d78f5cd973863993d258cd717ade4c99/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-04-28T12:45:44.048 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:44.062 INFO:teuthology.orchestra.run.smithi107:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-04-28T12:45:44.088 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:45:44.089 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:44.142 INFO:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:45:44.146 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2020-04-28T12:45:44.147 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:44.199 INFO:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c125c7d78f5cd973863993d258cd717ade4c99/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-04-28T12:45:44.215 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:44.266 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:44.269 INFO:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:45:44.320 INFO:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-04-28T12:45:44.358 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:44.372 INFO:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:45:44.401 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:44.442 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2020-04-28T12:45:44.444 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:44.454 INFO:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-04-28T12:45:44.499 INFO:teuthology.orchestra.run.smithi026:> sudo yum clean all 2020-04-28T12:45:44.520 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2020-04-28T12:45:44.521 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:44.574 INFO:teuthology.orchestra.run.smithi107:> sudo yum clean all 2020-04-28T12:45:44.795 INFO:teuthology.orchestra.run.smithi026.stdout:50 files removed 2020-04-28T12:45:44.825 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:45:44.839 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw 2020-04-28T12:45:44.853 INFO:teuthology.orchestra.run.smithi107.stdout:50 files removed 2020-04-28T12:45:44.881 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:45:44.895 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw 2020-04-28T12:45:45.625 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 183 kB/s | 69 kB 00:00 2020-04-28T12:45:45.647 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 184 kB/s | 69 kB 00:00 2020-04-28T12:45:45.964 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-28T12:45:45.985 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 45 kB/s | 14 kB 00:00 2020-04-28T12:45:46.296 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-28T12:45:46.313 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2020-04-28T12:45:46.491 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - AppStream 40 MB/s | 7.0 MB 00:00 2020-04-28T12:45:46.519 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-8 - AppStream 37 MB/s | 7.0 MB 00:00 2020-04-28T12:45:47.702 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-04-28T12:45:47.768 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-04-28T12:45:48.136 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-8 - Extras 73 kB/s | 5.5 kB 00:00 2020-04-28T12:45:48.223 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS-8 - Extras 73 kB/s | 5.5 kB 00:00 2020-04-28T12:45:48.326 INFO:teuthology.orchestra.run.smithi107.stdout:Copr repo for ceph-el8 owned by ktdreyer 322 kB/s | 47 kB 00:00 2020-04-28T12:45:48.362 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for ceph-el8 owned by ktdreyer 531 kB/s | 47 kB 00:00 2020-04-28T12:45:48.600 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 29 MB/s | 6.4 MB 00:00 2020-04-28T12:45:48.683 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 24 MB/s | 6.4 MB 00:00 2020-04-28T12:45:49.962 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 4.1 MB/s | 20 kB 00:00 2020-04-28T12:45:50.123 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 4.2 MB/s | 20 kB 00:00 2020-04-28T12:45:50.948 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:45:50.951 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:45:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2020-04-28T12:45:50.952 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:45:50.952 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:45:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:45:50.952 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2020-04-28T12:45:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:45:50.952 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:45:50.953 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:45:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:45:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:45:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:45:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:45:50.953 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:45:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:45:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse 2020-04-28T12:45:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:45:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:45:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:45:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:45:50.954 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:45:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:45:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:45:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:45:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:45:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:45:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:45:50.955 INFO:teuthology.orchestra.run.smithi107.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:45:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:45:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:45:50.956 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:45:50.956 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:45:50.956 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:45:50.956 INFO:teuthology.orchestra.run.smithi107.stdout:Install 21 Packages 2020-04-28T12:45:50.956 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 2 Packages 2020-04-28T12:45:50.957 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:45:50.957 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 51 M 2020-04-28T12:45:50.957 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:45:51.199 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:45:51.202 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:45:51.202 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2020-04-28T12:45:51.202 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:45:51.202 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:45:51.202 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 9.8 M 2020-04-28T12:45:51.203 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2020-04-28T12:45:51.203 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 3.6 M 2020-04-28T12:45:51.203 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 1.9 M 2020-04-28T12:45:51.203 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:45:51.203 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 5.5 M 2020-04-28T12:45:51.203 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 M 2020-04-28T12:45:51.203 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 25 k 2020-04-28T12:45:51.204 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 508 k 2020-04-28T12:45:51.204 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 377 k 2020-04-28T12:45:51.204 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 6.2 M 2020-04-28T12:45:51.204 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse 2020-04-28T12:45:51.204 INFO:teuthology.orchestra.run.smithi026.stdout: x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 40 k 2020-04-28T12:45:51.204 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 64 k 2020-04-28T12:45:51.204 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 162 k 2020-04-28T12:45:51.205 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 352 k 2020-04-28T12:45:51.205 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 309 k 2020-04-28T12:45:51.205 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 113 k 2020-04-28T12:45:51.205 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2020-04-28T12:45:51.205 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2020-04-28T12:45:51.205 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2020-04-28T12:45:51.205 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-1.el8 CentOS-Base 47 k 2020-04-28T12:45:51.206 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-04-28T12:45:51.206 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-04-28T12:45:51.206 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-04-28T12:45:51.206 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-04-28T12:45:51.206 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:45:51.206 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:45:51.206 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:45:51.207 INFO:teuthology.orchestra.run.smithi026.stdout:Install 21 Packages 2020-04-28T12:45:51.207 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2020-04-28T12:45:51.207 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:45:51.207 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 51 M 2020-04-28T12:45:51.208 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:45:51.677 INFO:teuthology.orchestra.run.smithi107.stdout:(1/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x8 7.6 MB/s | 5.5 MB 00:00 2020-04-28T12:45:51.716 INFO:teuthology.orchestra.run.smithi107.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 628 kB/s | 25 kB 00:00 2020-04-28T12:45:51.774 INFO:teuthology.orchestra.run.smithi107.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 8.5 MB/s | 508 kB 00:00 2020-04-28T12:45:51.827 INFO:teuthology.orchestra.run.smithi107.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 6.9 MB/s | 377 kB 00:00 2020-04-28T12:45:52.302 INFO:teuthology.orchestra.run.smithi107.stdout:(5/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86_ 13 MB/s | 6.2 MB 00:00 2020-04-28T12:45:52.349 INFO:teuthology.orchestra.run.smithi107.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 847 kB/s | 40 kB 00:00 2020-04-28T12:45:52.396 INFO:teuthology.orchestra.run.smithi107.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 1.3 MB/s | 64 kB 00:00 2020-04-28T12:45:52.446 INFO:teuthology.orchestra.run.smithi107.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 3.2 MB/s | 162 kB 00:00 2020-04-28T12:45:52.504 INFO:teuthology.orchestra.run.smithi107.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 6.0 MB/s | 352 kB 00:00 2020-04-28T12:45:52.560 INFO:teuthology.orchestra.run.smithi107.stdout:(10/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 5.3 MB/s | 309 kB 00:00 2020-04-28T12:45:52.610 INFO:teuthology.orchestra.run.smithi107.stdout:(11/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 2.2 MB/s | 113 kB 00:00 2020-04-28T12:45:52.667 INFO:teuthology.orchestra.run.smithi107.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 6.4 MB/s | 353 kB 00:00 2020-04-28T12:45:52.673 INFO:teuthology.orchestra.run.smithi107.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-04-28T12:45:52.673 INFO:teuthology.orchestra.run.smithi107.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 33 MB/s | 44 kB 00:00 2020-04-28T12:45:52.678 INFO:teuthology.orchestra.run.smithi107.stdout:(15/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 7.1 MB/s | 47 kB 00:00 2020-04-28T12:45:52.754 INFO:teuthology.orchestra.run.smithi107.stdout:(16/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el 5.5 MB/s | 9.8 MB 00:01 2020-04-28T12:45:52.789 INFO:teuthology.orchestra.run.smithi107.stdout:(17/23): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-04-28T12:45:52.809 INFO:teuthology.orchestra.run.smithi107.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-04-28T12:45:52.828 INFO:teuthology.orchestra.run.smithi107.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-04-28T12:45:52.831 INFO:teuthology.orchestra.run.smithi107.stdout:(20/23): leveldb-1.22-1.el8.x86_64.rpm 2.2 MB/s | 181 kB 00:00 2020-04-28T12:45:53.194 INFO:teuthology.orchestra.run.smithi107.stdout:(21/23): ceph-common-15.2.1-136.ga8c125c7d7.el8 9.2 MB/s | 21 MB 00:02 2020-04-28T12:45:53.209 INFO:teuthology.orchestra.run.smithi107.stdout:(22/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 9.4 MB/s | 3.6 MB 00:00 2020-04-28T12:45:53.215 INFO:teuthology.orchestra.run.smithi107.stdout:(23/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 5.0 MB/s | 1.9 MB 00:00 2020-04-28T12:45:53.217 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:45:53.218 INFO:teuthology.orchestra.run.smithi107.stdout:Total 22 MB/s | 51 MB 00:02 2020-04-28T12:45:53.223 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:45:53.266 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:45:53.266 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:45:53.624 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:45:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:45:53.905 INFO:teuthology.orchestra.run.smithi026.stdout:(1/23): ceph-radosgw-15.2.1-136.ga8c125c7d7.el8 3.6 MB/s | 9.8 MB 00:02 2020-04-28T12:45:53.943 INFO:teuthology.orchestra.run.smithi026.stdout:(2/23): ceph-selinux-15.2.1-136.ga8c125c7d7.el8 660 kB/s | 25 kB 00:00 2020-04-28T12:45:53.988 INFO:teuthology.orchestra.run.smithi026.stdout:(3/23): libcephfs2-15.2.1-136.ga8c125c7d7.el8.x 11 MB/s | 508 kB 00:00 2020-04-28T12:45:54.029 INFO:teuthology.orchestra.run.smithi026.stdout:(4/23): libradosstriper1-15.2.1-136.ga8c125c7d7 9.1 MB/s | 377 kB 00:00 2020-04-28T12:45:54.446 INFO:teuthology.orchestra.run.smithi026.stdout:(5/23): librgw2-15.2.1-136.ga8c125c7d7.el8.x86_ 15 MB/s | 6.2 MB 00:00 2020-04-28T12:45:54.484 INFO:teuthology.orchestra.run.smithi026.stdout:(6/23): python3-ceph-argparse-15.2.1-136.ga8c12 1.0 MB/s | 40 kB 00:00 2020-04-28T12:45:54.521 INFO:teuthology.orchestra.run.smithi026.stdout:(7/23): python3-ceph-common-15.2.1-136.ga8c125c 1.7 MB/s | 64 kB 00:00 2020-04-28T12:45:54.559 INFO:teuthology.orchestra.run.smithi026.stdout:(8/23): python3-cephfs-15.2.1-136.ga8c125c7d7.e 4.1 MB/s | 162 kB 00:00 2020-04-28T12:45:54.600 INFO:teuthology.orchestra.run.smithi026.stdout:(9/23): python3-rados-15.2.1-136.ga8c125c7d7.el 8.5 MB/s | 352 kB 00:00 2020-04-28T12:45:54.623 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:45:54.640 INFO:teuthology.orchestra.run.smithi026.stdout:(10/23): python3-rbd-15.2.1-136.ga8c125c7d7.el8 7.6 MB/s | 309 kB 00:00 2020-04-28T12:45:54.677 INFO:teuthology.orchestra.run.smithi026.stdout:(11/23): python3-rgw-15.2.1-136.ga8c125c7d7.el8 3.0 MB/s | 113 kB 00:00 2020-04-28T12:45:54.713 INFO:teuthology.orchestra.run.smithi026.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 9.8 MB/s | 353 kB 00:00 2020-04-28T12:45:54.716 INFO:teuthology.orchestra.run.smithi026.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 66 MB/s | 259 kB 00:00 2020-04-28T12:45:54.718 INFO:teuthology.orchestra.run.smithi026.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 28 MB/s | 44 kB 00:00 2020-04-28T12:45:54.720 INFO:teuthology.orchestra.run.smithi026.stdout:(15/23): librabbitmq-0.9.0-1.el8.x86_64.rpm 30 MB/s | 47 kB 00:00 2020-04-28T12:45:54.834 INFO:teuthology.orchestra.run.smithi026.stdout:(16/23): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-04-28T12:45:54.855 INFO:teuthology.orchestra.run.smithi026.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 8.7 MB/s | 181 kB 00:00 2020-04-28T12:45:54.864 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:45:54.874 INFO:teuthology.orchestra.run.smithi026.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-04-28T12:45:54.894 INFO:teuthology.orchestra.run.smithi026.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-04-28T12:45:55.062 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:45:55.244 INFO:teuthology.orchestra.run.smithi026.stdout:(20/23): librados2-15.2.1-136.ga8c125c7d7.el8.x 10 MB/s | 3.6 MB 00:00 2020-04-28T12:45:55.477 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:45:55.503 INFO:teuthology.orchestra.run.smithi026.stdout:(21/23): librbd1-15.2.1-136.ga8c125c7d7.el8.x86 7.4 MB/s | 1.9 MB 00:00 2020-04-28T12:45:55.671 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:45:55.745 INFO:teuthology.orchestra.run.smithi026.stdout:(22/23): ceph-base-15.2.1-136.ga8c125c7d7.el8.x 1.2 MB/s | 5.5 MB 00:04 2020-04-28T12:45:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:45:56.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:45:56.154 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:45:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:45:56.595 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:45:56.648 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:45:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:45:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:45:57.557 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:45:57.728 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:45:57.805 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:45:57.983 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:45:58.104 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:45:58.291 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:45:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:45:58.681 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:45:58.861 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:45:58.934 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:45:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:45:59.367 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:45:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:45:59.728 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:46:00.560 INFO:teuthology.orchestra.run.smithi026.stdout:(23/23): ceph-common-15.2.1-136.ga8c125c7d7.el8 2.2 MB/s | 21 MB 00:09 2020-04-28T12:46:00.564 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:46:00.564 INFO:teuthology.orchestra.run.smithi026.stdout:Total 5.4 MB/s | 51 MB 00:09 2020-04-28T12:46:00.571 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:46:00.623 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:46:00.623 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:46:01.010 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:46:01.010 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:46:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:46:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2020-04-28T12:46:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:46:02.919 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2020-04-28T12:46:03.107 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:46:03.205 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:46:03.230 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:46:03.418 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:46:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:46:03.558 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:46:03.835 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:46:04.023 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:46:04.095 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/25 2020-04-28T12:46:04.143 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:46:04.283 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 7/25 2020-04-28T12:46:04.406 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:46:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:46:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:46:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:46:05.091 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2020-04-28T12:46:05.274 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:46:05.369 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 9/25 2020-04-28T12:46:05.545 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2020-04-28T12:46:05.684 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 11/25 2020-04-28T12:46:05.869 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:46:06.063 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:46:06.261 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 14/25 2020-04-28T12:46:06.423 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:46:06.498 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 15/25 2020-04-28T12:46:06.689 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2020-04-28T12:46:06.881 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 17/25 2020-04-28T12:46:07.073 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2020-04-28T12:46:07.282 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 19/25 2020-04-28T12:46:11.026 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:46:11.198 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:46:11.929 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 20/25 2020-04-28T12:46:12.214 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:46:12.312 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 21/25 2020-04-28T12:46:12.447 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:46:20.878 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:46:20.878 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2020-04-28T12:46:20.878 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2020-04-28T12:46:20.879 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /dev 2020-04-28T12:46:20.879 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /run 2020-04-28T12:46:20.879 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2020-04-28T12:46:20.879 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2020-04-28T12:46:20.879 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2020-04-28T12:46:20.879 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2020-04-28T12:46:20.880 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /dev 2020-04-28T12:46:20.880 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:46:22.039 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:46:22.039 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:46:22.875 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:46:22.876 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:46:23.587 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:46:23.587 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:46:23.587 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:46:23.588 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:46:23.588 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:46:23.588 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:46:23.588 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:46:23.588 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:46:23.588 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:46:23.588 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:46:23.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:46:23.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:46:23.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:46:23.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:46:23.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:46:23.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:46:23.589 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:46:23.590 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:46:23.590 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:46:23.590 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:46:23.590 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:46:23.590 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:46:23.591 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:46:23.591 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:46:23.591 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:46:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:46:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:24.350 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2020-04-28T12:46:24.350 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:24.351 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:46:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.351 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.352 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:46:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:46:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:46:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:46:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:46:24.353 INFO:teuthology.orchestra.run.smithi107.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:46:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:46:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:46:24.354 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:24.354 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:46:24.683 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:46:24.698 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-test 2020-04-28T12:46:25.145 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:36 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:46:25.503 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:46:25.504 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:25.505 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2020-04-28T12:46:25.505 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:25.505 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:46:25.505 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:46:25.505 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:46:25.506 INFO:teuthology.orchestra.run.smithi107.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:46:25.506 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:46:25.506 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:46:25.506 INFO:teuthology.orchestra.run.smithi107.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:46:25.506 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:46:25.506 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:25.508 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:46:25.508 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:25.508 INFO:teuthology.orchestra.run.smithi107.stdout:Install 6 Packages 2020-04-28T12:46:25.508 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:25.509 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 43 M 2020-04-28T12:46:25.509 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 185 M 2020-04-28T12:46:25.509 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:46:25.540 INFO:teuthology.orchestra.run.smithi107.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2020-04-28T12:46:25.550 INFO:teuthology.orchestra.run.smithi107.stdout:(2/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.3 MB/s | 188 kB 00:00 2020-04-28T12:46:25.551 INFO:teuthology.orchestra.run.smithi107.stdout:(3/6): socat-1.7.3.2-6.el8.x86_64.rpm 27 MB/s | 298 kB 00:00 2020-04-28T12:46:25.554 INFO:teuthology.orchestra.run.smithi107.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 55 MB/s | 249 kB 00:00 2020-04-28T12:46:25.613 INFO:teuthology.orchestra.run.smithi107.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-04-28T12:46:28.785 INFO:teuthology.orchestra.run.smithi107.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 13 MB/s | 42 MB 00:03 2020-04-28T12:46:28.788 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:46:28.788 INFO:teuthology.orchestra.run.smithi107.stdout:Total 13 MB/s | 43 MB 00:03 2020-04-28T12:46:28.794 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:46:28.816 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:46:28.816 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:46:29.103 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:46:29.103 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:46:29.279 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:46:29.279 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2020-04-28T12:46:29.279 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2020-04-28T12:46:29.279 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2020-04-28T12:46:29.280 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:29.698 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:46:29.907 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:46:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:46:30.308 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:46:30.411 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:46:30.484 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 23/25 2020-04-28T12:46:30.484 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:46:30.496 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:46:30.582 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:46:30.713 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2020-04-28T12:46:30.713 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:46:31.389 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:46:31.389 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/25 2020-04-28T12:46:31.389 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/25 2020-04-28T12:46:31.389 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/25 2020-04-28T12:46:31.389 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/25 2020-04-28T12:46:31.390 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/25 2020-04-28T12:46:31.390 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_ 6/25 2020-04-28T12:46:31.390 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 7/25 2020-04-28T12:46:31.390 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8 8/25 2020-04-28T12:46:31.390 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x 9/25 2020-04-28T12:46:31.390 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 10/25 2020-04-28T12:46:31.390 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 11/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 12/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 13/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 17/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 18/25 2020-04-28T12:46:31.391 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2020-04-28T12:46:31.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2020-04-28T12:46:31.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2020-04-28T12:46:31.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 22/25 2020-04-28T12:46:31.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2020-04-28T12:46:31.392 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 24/25 2020-04-28T12:46:32.374 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2020-04-28T12:46:32.374 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:32.374 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2020-04-28T12:46:32.374 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.374 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.374 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:32.375 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:46:32.375 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.375 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.375 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.375 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.375 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.375 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.376 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.376 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-04-28T12:46:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-04-28T12:46:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-04-28T12:46:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-04-28T12:46:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-04-28T12:46:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: leveldb-1.22-1.el8.x86_64 2020-04-28T12:46:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2020-04-28T12:46:32.378 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2020-04-28T12:46:32.378 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:32.378 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:46:32.726 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:46:32.747 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-test 2020-04-28T12:46:33.220 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:43 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:46:33.621 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:46:33.622 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:46:33.622 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2020-04-28T12:46:33.622 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:46:33.623 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:46:33.623 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 42 M 2020-04-28T12:46:33.623 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:46:33.623 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2020-04-28T12:46:33.623 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-1.el8 CentOS-AppStream 188 k 2020-04-28T12:46:33.623 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.3.2-6.el8 CentOS-AppStream 298 k 2020-04-28T12:46:33.623 INFO:teuthology.orchestra.run.smithi026.stdout: libxslt x86_64 1.1.32-3.el8 CentOS-Base 249 k 2020-04-28T12:46:33.624 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-04-28T12:46:33.624 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:33.624 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:46:33.624 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:46:33.624 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2020-04-28T12:46:33.624 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:33.625 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 43 M 2020-04-28T12:46:33.625 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 185 M 2020-04-28T12:46:33.625 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:46:33.657 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.8 MB/s | 161 kB 00:00 2020-04-28T12:46:33.662 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): socat-1.7.3.2-6.el8.x86_64.rpm 59 MB/s | 298 kB 00:00 2020-04-28T12:46:33.670 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): oniguruma-6.8.2-1.el8.x86_64.rpm 4.1 MB/s | 188 kB 00:00 2020-04-28T12:46:33.671 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): libxslt-1.1.32-3.el8.x86_64.rpm 29 MB/s | 249 kB 00:00 2020-04-28T12:46:33.734 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2020-04-28T12:46:34.931 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:46:36.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:46:36.381 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:46:36.382 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:46:36.382 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:46:36.382 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:46:36.382 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:46:36.382 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:46:36.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:46:36.751 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:36.751 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:46:36.751 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:46:36.751 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:46:36.751 INFO:teuthology.orchestra.run.smithi107.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:46:36.751 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:36.751 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:46:37.010 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:46:37.023 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph 2020-04-28T12:46:37.461 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:48 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:46:37.876 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:46:37.880 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: Package ArchVersion Repository Size 2020-04-28T12:46:37.880 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:37.880 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:46:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:46:37.880 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:46:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:46:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:46:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:46:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:46:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:46:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:46:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:46:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:46:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:46:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:46:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:46:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:46:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:46:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:46:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:46:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:46:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:46:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:46:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:46:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:46:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:46:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:46:37.885 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2020-04-28T12:46:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:46:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:46:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:37.885 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:46:37.886 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:37.886 INFO:teuthology.orchestra.run.smithi107.stdout:Install 32 Packages 2020-04-28T12:46:37.886 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:37.887 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 29 M 2020-04-28T12:46:37.887 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 103 M 2020-04-28T12:46:37.887 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:46:37.946 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): ceph-test-15.2.1-136.ga8c125c7d7.el8.x86 9.7 MB/s | 42 MB 00:04 2020-04-28T12:46:37.949 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:46:37.949 INFO:teuthology.orchestra.run.smithi026.stdout:Total 9.9 MB/s | 43 MB 00:04 2020-04-28T12:46:37.956 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:46:37.981 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:46:37.981 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:46:38.037 INFO:teuthology.orchestra.run.smithi107.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2020-04-28T12:46:38.266 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:46:38.266 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:46:38.513 INFO:teuthology.orchestra.run.smithi107.stdout:(2/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 2.3 MB/s | 1.4 MB 00:00 2020-04-28T12:46:38.651 INFO:teuthology.orchestra.run.smithi107.stdout:(3/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 2.7 MB/s | 2.0 MB 00:00 2020-04-28T12:46:38.691 INFO:teuthology.orchestra.run.smithi107.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 4.0 MB/s | 164 kB 00:00 2020-04-28T12:46:38.723 INFO:teuthology.orchestra.run.smithi107.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 6.5 MB/s | 214 kB 00:00 2020-04-28T12:46:38.742 INFO:teuthology.orchestra.run.smithi107.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 80 MB/s | 1.5 MB 00:00 2020-04-28T12:46:38.745 INFO:teuthology.orchestra.run.smithi107.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 60 MB/s | 157 kB 00:00 2020-04-28T12:46:38.746 INFO:teuthology.orchestra.run.smithi107.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2020-04-28T12:46:38.747 INFO:teuthology.orchestra.run.smithi107.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 41 MB/s | 54 kB 00:00 2020-04-28T12:46:38.748 INFO:teuthology.orchestra.run.smithi107.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 26 MB/s | 27 kB 00:00 2020-04-28T12:46:38.759 INFO:teuthology.orchestra.run.smithi107.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 43 MB/s | 457 kB 00:00 2020-04-28T12:46:38.795 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:46:38.820 INFO:teuthology.orchestra.run.smithi107.stdout:(12/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.3 MB/s | 145 kB 00:00 2020-04-28T12:46:38.843 INFO:teuthology.orchestra.run.smithi107.stdout:(13/32): python3-cherrypy-18.4.0-1.el8.noarch.r 16 MB/s | 385 kB 00:00 2020-04-28T12:46:38.851 INFO:teuthology.orchestra.run.smithi107.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-28T12:46:38.860 INFO:teuthology.orchestra.run.smithi107.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 2.0 MB/s | 18 kB 00:00 2020-04-28T12:46:38.868 INFO:teuthology.orchestra.run.smithi107.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 5.7 MB/s | 49 kB 00:00 2020-04-28T12:46:38.884 INFO:teuthology.orchestra.run.smithi107.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 3.8 MB/s | 59 kB 00:00 2020-04-28T12:46:38.896 INFO:teuthology.orchestra.run.smithi107.stdout:(18/32): python3-pecan-1.3.2-9.el8.noarch.rpm 24 MB/s | 283 kB 00:00 2020-04-28T12:46:38.904 INFO:teuthology.orchestra.run.smithi107.stdout:(19/32): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-04-28T12:46:38.913 INFO:teuthology.orchestra.run.smithi107.stdout:(20/32): python3-simplegeneric-0.8.1-17.el8.noa 2.3 MB/s | 19 kB 00:00 2020-04-28T12:46:38.921 INFO:teuthology.orchestra.run.smithi107.stdout:(21/32): python3-singledispatch-3.4.0.3-18.el8. 3.0 MB/s | 24 kB 00:00 2020-04-28T12:46:38.929 INFO:teuthology.orchestra.run.smithi107.stdout:(22/32): python3-tempora-1.14.1-5.el8.noarch.rp 3.6 MB/s | 30 kB 00:00 2020-04-28T12:46:38.937 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 1/6 2020-04-28T12:46:38.937 INFO:teuthology.orchestra.run.smithi107.stdout:(23/32): python3-trustme-0.5.2-4.el8.noarch.rpm 3.3 MB/s | 27 kB 00:00 2020-04-28T12:46:38.947 INFO:teuthology.orchestra.run.smithi107.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.3 MB/s | 23 kB 00:00 2020-04-28T12:46:39.010 INFO:teuthology.orchestra.run.smithi107.stdout:(25/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 701 kB/s | 44 kB 00:00 2020-04-28T12:46:39.056 INFO:teuthology.orchestra.run.smithi107.stdout:(26/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.9 MB/s | 185 kB 00:00 2020-04-28T12:46:39.072 INFO:teuthology.orchestra.run.smithi107.stdout:(27/32): python3-cssselect-0.9.2-10.el8.noarch. 2.5 MB/s | 40 kB 00:00 2020-04-28T12:46:39.086 INFO:teuthology.orchestra.run.smithi107.stdout:(28/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 4.2 MB/s | 4.4 MB 00:01 2020-04-28T12:46:39.103 INFO:teuthology.orchestra.run.smithi107.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 7.5 MB/s | 241 kB 00:00 2020-04-28T12:46:39.120 INFO:teuthology.orchestra.run.smithi107.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 5.2 MB/s | 85 kB 00:00 2020-04-28T12:46:39.167 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2020-04-28T12:46:39.197 INFO:teuthology.orchestra.run.smithi107.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.2 MB/s | 251 kB 00:00 2020-04-28T12:46:39.347 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 3/6 2020-04-28T12:46:39.501 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:46:39.601 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 4/6 2020-04-28T12:46:40.213 INFO:teuthology.orchestra.run.smithi107.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 9.8 MB/s | 17 MB 00:01 2020-04-28T12:46:40.216 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:46:40.217 INFO:teuthology.orchestra.run.smithi107.stdout:Total 12 MB/s | 29 MB 00:02 2020-04-28T12:46:40.233 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:46:40.270 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:46:40.270 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:46:40.592 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:46:40.592 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:46:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:46:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:46:42.224 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:46:42.437 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:46:42.603 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:46:42.818 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:46:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:46:43.133 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:46:43.314 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:46:43.469 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:46:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:46:43.790 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:46:43.884 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2020-04-28T12:46:43.955 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:46:44.206 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:46:44.228 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:46:44.412 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 6/6 2020-04-28T12:46:44.413 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/6 2020-04-28T12:46:44.413 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2020-04-28T12:46:44.413 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 3/6 2020-04-28T12:46:44.413 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 4/6 2020-04-28T12:46:44.413 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 5/6 2020-04-28T12:46:44.437 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:46:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:46:44.751 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2020-04-28T12:46:44.751 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:44.752 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:46:44.752 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:15.2.1-136.ga8c125c7d7.el8.x86_64 jq-1.5-12.el8.x86_64 2020-04-28T12:46:44.752 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.8.2-1.el8.x86_64 socat-1.7.3.2-6.el8.x86_64 2020-04-28T12:46:44.752 INFO:teuthology.orchestra.run.smithi026.stdout: libxslt-1.1.32-3.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2020-04-28T12:46:44.752 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:44.752 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:46:44.871 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:46:44.999 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:46:45.012 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph 2020-04-28T12:46:45.262 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:46:45.476 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:55 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:46:45.533 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:46:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:46:45.871 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:46:45.874 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:46:45.875 INFO:teuthology.orchestra.run.smithi026.stdout: Package ArchVersion Repository Size 2020-04-28T12:46:45.875 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:46:45.875 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:46:45.875 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 6.4 k 2020-04-28T12:46:45.875 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:46:45.875 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 2.0 M 2020-04-28T12:46:45.875 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 1.4 M 2020-04-28T12:46:45.876 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 4.4 M 2020-04-28T12:46:45.876 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_642:15.2.1-136.ga8c125c7d7.el8 ceph 17 M 2020-04-28T12:46:45.876 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 164 k 2020-04-28T12:46:45.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-04-28T12:46:45.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-04-28T12:46:45.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-04-28T12:46:45.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-04-28T12:46:45.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch7.2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-04-28T12:46:45.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-04-28T12:46:45.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-04-28T12:46:45.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-04-28T12:46:45.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-04-28T12:46:45.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-04-28T12:46:45.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-04-28T12:46:45.879 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-04-28T12:46:45.879 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-04-28T12:46:45.879 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-04-28T12:46:45.879 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-04-28T12:46:45.879 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-04-28T12:46:45.879 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-04-28T12:46:45.879 INFO:teuthology.orchestra.run.smithi026.stdout:Installing weak dependencies: 2020-04-28T12:46:45.880 INFO:teuthology.orchestra.run.smithi026.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-04-28T12:46:45.880 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-04-28T12:46:45.880 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:45.880 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:46:45.880 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:46:45.880 INFO:teuthology.orchestra.run.smithi026.stdout:Install 32 Packages 2020-04-28T12:46:45.880 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:45.881 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 29 M 2020-04-28T12:46:45.881 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 103 M 2020-04-28T12:46:45.882 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:46:45.937 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:46:46.033 INFO:teuthology.orchestra.run.smithi026.stdout:(1/32): ceph-15.2.1-136.ga8c125c7d7.el8.x86_64. 42 kB/s | 6.4 kB 00:00 2020-04-28T12:46:46.142 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:46:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:46:46.470 INFO:teuthology.orchestra.run.smithi026.stdout:(2/32): ceph-mgr-15.2.1-136.ga8c125c7d7.el8.x86 2.4 MB/s | 1.4 MB 00:00 2020-04-28T12:46:46.555 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:46:46.573 INFO:teuthology.orchestra.run.smithi026.stdout:(3/32): ceph-mds-15.2.1-136.ga8c125c7d7.el8.x86 3.0 MB/s | 2.0 MB 00:00 2020-04-28T12:46:46.604 INFO:teuthology.orchestra.run.smithi026.stdout:(4/32): ceph-mgr-modules-core-15.2.1-136.ga8c12 4.2 MB/s | 164 kB 00:00 2020-04-28T12:46:46.639 INFO:teuthology.orchestra.run.smithi026.stdout:(5/32): python3-html5lib-0.999999999-6.el8.noar 6.2 MB/s | 214 kB 00:00 2020-04-28T12:46:46.657 INFO:teuthology.orchestra.run.smithi026.stdout:(6/32): python3-lxml-4.2.3-1.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2020-04-28T12:46:46.660 INFO:teuthology.orchestra.run.smithi026.stdout:(7/32): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2020-04-28T12:46:46.662 INFO:teuthology.orchestra.run.smithi026.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 30 MB/s | 39 kB 00:00 2020-04-28T12:46:46.663 INFO:teuthology.orchestra.run.smithi026.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 34 MB/s | 54 kB 00:00 2020-04-28T12:46:46.665 INFO:teuthology.orchestra.run.smithi026.stdout:(10/32): python3-webencodings-0.5.1-6.el8.noarc 24 MB/s | 27 kB 00:00 2020-04-28T12:46:46.671 INFO:teuthology.orchestra.run.smithi026.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 73 MB/s | 457 kB 00:00 2020-04-28T12:46:46.735 INFO:teuthology.orchestra.run.smithi026.stdout:(12/32): python3-cheroot-8.2.1-1.el8.noarch.rpm 2.2 MB/s | 145 kB 00:00 2020-04-28T12:46:46.757 INFO:teuthology.orchestra.run.smithi026.stdout:(13/32): python3-cherrypy-18.4.0-1.el8.noarch.r 17 MB/s | 385 kB 00:00 2020-04-28T12:46:46.765 INFO:teuthology.orchestra.run.smithi026.stdout:(14/32): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2020-04-28T12:46:46.774 INFO:teuthology.orchestra.run.smithi026.stdout:(15/32): python3-jaraco-functools-2.0-4.el8.noa 2.0 MB/s | 18 kB 00:00 2020-04-28T12:46:46.778 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:46:46.783 INFO:teuthology.orchestra.run.smithi026.stdout:(16/32): python3-logutils-0.3.5-11.el8.noarch.r 5.6 MB/s | 49 kB 00:00 2020-04-28T12:46:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:(17/32): python3-more-itertools-7.2.0-4.el8.noa 3.7 MB/s | 59 kB 00:00 2020-04-28T12:46:46.817 INFO:teuthology.orchestra.run.smithi026.stdout:(18/32): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-04-28T12:46:46.829 INFO:teuthology.orchestra.run.smithi026.stdout:(19/32): python3-portend-2.6-1.el8.noarch.rpm 1.3 MB/s | 16 kB 00:00 2020-04-28T12:46:46.846 INFO:teuthology.orchestra.run.smithi026.stdout:(20/32): python3-simplegeneric-0.8.1-17.el8.noa 1.1 MB/s | 19 kB 00:00 2020-04-28T12:46:46.867 INFO:teuthology.orchestra.run.smithi026.stdout:(21/32): python3-singledispatch-3.4.0.3-18.el8. 1.1 MB/s | 24 kB 00:00 2020-04-28T12:46:46.889 INFO:teuthology.orchestra.run.smithi026.stdout:(22/32): python3-tempora-1.14.1-5.el8.noarch.rp 1.3 MB/s | 30 kB 00:00 2020-04-28T12:46:46.905 INFO:teuthology.orchestra.run.smithi026.stdout:(23/32): python3-trustme-0.5.2-4.el8.noarch.rpm 1.7 MB/s | 27 kB 00:00 2020-04-28T12:46:46.914 INFO:teuthology.orchestra.run.smithi026.stdout:(24/32): python3-zc-lockfile-2.0-2.el8.noarch.r 2.6 MB/s | 23 kB 00:00 2020-04-28T12:46:46.990 INFO:teuthology.orchestra.run.smithi026.stdout:(25/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 575 kB/s | 44 kB 00:00 2020-04-28T12:46:47.046 INFO:teuthology.orchestra.run.smithi026.stdout:(26/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.2 MB/s | 185 kB 00:00 2020-04-28T12:46:47.065 INFO:teuthology.orchestra.run.smithi026.stdout:(27/32): python3-cssselect-0.9.2-10.el8.noarch. 2.1 MB/s | 40 kB 00:00 2020-04-28T12:46:47.103 INFO:teuthology.orchestra.run.smithi026.stdout:(28/32): python3-waitress-1.2.1-2.el8.1.noarch. 6.2 MB/s | 241 kB 00:00 2020-04-28T12:46:47.124 INFO:teuthology.orchestra.run.smithi026.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 12 MB/s | 251 kB 00:00 2020-04-28T12:46:47.144 INFO:teuthology.orchestra.run.smithi026.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 4.3 MB/s | 85 kB 00:00 2020-04-28T12:46:47.169 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:46:47.204 INFO:teuthology.orchestra.run.smithi026.stdout:(31/32): ceph-mon-15.2.1-136.ga8c125c7d7.el8.x8 3.7 MB/s | 4.4 MB 00:01 2020-04-28T12:46:47.466 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:46:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:46:48.003 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:46:48.107 INFO:teuthology.orchestra.run.smithi026.stdout:(32/32): ceph-osd-15.2.1-136.ga8c125c7d7.el8.x8 10 MB/s | 17 MB 00:01 2020-04-28T12:46:48.110 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:46:48.110 INFO:teuthology.orchestra.run.smithi026.stdout:Total 13 MB/s | 29 MB 00:02 2020-04-28T12:46:48.129 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:46:48.170 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:46:48.170 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:46:48.493 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:46:48.494 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:46:49.413 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:46:49.601 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:46:49.704 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:46:49.928 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 1/32 2020-04-28T12:46:49.986 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:46:50.152 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-4.el8.noarch 2/32 2020-04-28T12:46:50.184 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:46:50.360 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 3/32 2020-04-28T12:46:50.377 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:46:50.510 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 4/32 2020-04-28T12:46:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:46:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:46:50.696 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:46:50.725 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/32 2020-04-28T12:46:50.908 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 6/32 2020-04-28T12:46:51.004 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:46:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:46:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:46:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:46:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:46:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:46:51.005 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:46:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:46:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:46:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:46:51.006 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:46:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:46:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:46:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:46:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:46:51.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:46:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:46:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:46:51.008 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:46:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:46:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:46:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:46:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:46:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:46:51.009 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:46:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:46:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:46:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:46:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:46:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:46:51.010 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:46:51.011 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:46:51.074 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 7/32 2020-04-28T12:46:51.255 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 8/32 2020-04-28T12:46:51.413 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 9/32 2020-04-28T12:46:51.588 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 10/32 2020-04-28T12:46:51.747 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 11/32 2020-04-28T12:46:51.944 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2020-04-28T12:46:52.072 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:46:52.073 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:52.073 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:46:52.073 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:52.073 INFO:teuthology.orchestra.run.smithi107.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:46:52.073 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:46:52.073 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:52.073 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:52.074 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:52.074 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:52.074 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:46:52.074 INFO:teuthology.orchestra.run.smithi107.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:46:52.074 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:46:52.074 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:46:52.075 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:46:52.076 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:46:52.076 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:46:52.076 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:46:52.076 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:46:52.076 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:46:52.076 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:46:52.076 INFO:teuthology.orchestra.run.smithi107.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:46:52.077 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:46:52.077 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:46:52.077 INFO:teuthology.orchestra.run.smithi107.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:46:52.077 INFO:teuthology.orchestra.run.smithi107.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:46:52.077 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:46:52.077 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:46:52.077 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:52.078 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:46:52.228 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 13/32 2020-04-28T12:46:52.453 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/32 2020-04-28T12:46:52.464 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:46:52.478 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-base 2020-04-28T12:46:52.692 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 15/32 2020-04-28T12:46:52.922 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:03 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:46:52.949 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 16/32 2020-04-28T12:46:53.177 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:46:53.277 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:46:53.278 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:46:53.279 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:46:53.349 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 17/32 2020-04-28T12:46:53.423 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:46:53.437 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install cephadm 2020-04-28T12:46:53.618 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 18/32 2020-04-28T12:46:53.856 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 19/32 2020-04-28T12:46:53.874 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:04 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:46:54.045 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2020-04-28T12:46:54.222 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:46:54.222 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2020-04-28T12:46:54.223 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:54.223 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:46:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:46:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:54.223 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:46:54.223 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:54.224 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-04-28T12:46:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:54.224 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 41 k 2020-04-28T12:46:54.225 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 161 k 2020-04-28T12:46:54.225 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:46:54.263 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2020-04-28T12:46:54.461 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 172 kB/s | 41 kB 00:00 2020-04-28T12:46:54.462 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:46:54.462 INFO:teuthology.orchestra.run.smithi107.stdout:Total 171 kB/s | 41 kB 00:00 2020-04-28T12:46:54.465 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:46:54.471 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:46:54.471 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:46:54.473 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:46:54.473 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:46:54.494 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2020-04-28T12:46:54.517 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:46:54.688 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2020-04-28T12:46:54.934 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2020-04-28T12:46:55.271 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2020-04-28T12:46:55.542 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2020-04-28T12:46:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:46:55.890 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 27/32 2020-04-28T12:46:56.041 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:46:56.133 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:46:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:46:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:56.347 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:46:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:56.348 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:46:56.525 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:46:56.539 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:46:56.982 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:07 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:46:57.496 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:46:57.497 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:57.497 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2020-04-28T12:46:57.497 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:57.498 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:46:57.498 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:46:57.498 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:57.498 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:46:57.498 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:46:57.498 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-04-28T12:46:57.498 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:57.499 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 203 k 2020-04-28T12:46:57.499 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 743 k 2020-04-28T12:46:57.499 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:46:57.551 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 28/32 2020-04-28T12:46:57.699 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:46:57.884 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 527 kB/s | 203 kB 00:00 2020-04-28T12:46:57.885 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:46:57.885 INFO:teuthology.orchestra.run.smithi107.stdout:Total 525 kB/s | 203 kB 00:00 2020-04-28T12:46:57.886 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:46:57.899 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:46:57.899 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:46:57.945 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:46:57.945 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:46:58.066 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:46:58.107 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 29/32 2020-04-28T12:46:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:46:58.248 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:46:58.452 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 30/32 2020-04-28T12:46:58.549 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:46:58.557 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:46:58.574 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 31/32 2020-04-28T12:46:58.735 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:46:58.791 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:46:58.791 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:58.791 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:46:58.791 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:58.791 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:46:58.792 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:46:59.040 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:46:59.053 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr 2020-04-28T12:46:59.061 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 32/32 2020-04-28T12:46:59.061 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/32 2020-04-28T12:46:59.061 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2/32 2020-04-28T12:46:59.062 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/32 2020-04-28T12:46:59.062 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 4/32 2020-04-28T12:46:59.062 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 5/32 2020-04-28T12:46:59.062 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8 6/32 2020-04-28T12:46:59.062 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/32 2020-04-28T12:46:59.062 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 14/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 15/32 2020-04-28T12:46:59.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 16/32 2020-04-28T12:46:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 17/32 2020-04-28T12:46:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 18/32 2020-04-28T12:46:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-4.el8.noarch 19/32 2020-04-28T12:46:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 20/32 2020-04-28T12:46:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 21/32 2020-04-28T12:46:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 22/32 2020-04-28T12:46:59.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 23/32 2020-04-28T12:46:59.065 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 24/32 2020-04-28T12:46:59.065 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 25/32 2020-04-28T12:46:59.065 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 26/32 2020-04-28T12:46:59.065 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 27/32 2020-04-28T12:46:59.066 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 28/32 2020-04-28T12:46:59.066 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 29/32 2020-04-28T12:46:59.066 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 30/32 2020-04-28T12:46:59.066 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 31/32 2020-04-28T12:46:59.498 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:10 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:46:59.742 INFO:teuthology.orchestra.run.smithi107.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:46:59.844 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:46:59.845 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:46:59.846 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:46:59.866 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 32/32 2020-04-28T12:46:59.866 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:59.866 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:46:59.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:59.867 INFO:teuthology.orchestra.run.smithi026.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-04-28T12:46:59.867 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-04-28T12:46:59.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:59.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:59.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:59.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:46:59.868 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:46:59.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-04-28T12:46:59.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-13.el8.noarch 2020-04-28T12:46:59.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-04-28T12:46:59.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-9.el8.noarch 2020-04-28T12:46:59.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-04-28T12:46:59.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-04-28T12:46:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-04-28T12:46:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-04-28T12:46:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2020-04-28T12:46:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-04-28T12:46:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-04-28T12:46:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-4.el8.noarch 2020-04-28T12:46:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-04-28T12:46:59.870 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-04-28T12:46:59.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-04-28T12:46:59.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-04-28T12:46:59.871 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-04-28T12:46:59.871 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:46:59.871 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:00.005 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:00.019 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:47:00.133 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:00.147 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-base 2020-04-28T12:47:00.455 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:11 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:00.627 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:10 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:00.803 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:00.804 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:00.804 INFO:teuthology.orchestra.run.smithi107.stdout: Package ArchVersion Repository Size 2020-04-28T12:47:00.804 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:00.804 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:00.804 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:47:00.804 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:47:00.805 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:47:00.805 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:47:00.805 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:47:00.805 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:47:00.805 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:47:00.805 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:00.805 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:00.806 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:00.806 INFO:teuthology.orchestra.run.smithi107.stdout:Install 6 Packages 2020-04-28T12:47:00.806 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:00.806 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 3.6 M 2020-04-28T12:47:00.807 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 19 M 2020-04-28T12:47:00.807 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:00.882 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-base-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:00.967 INFO:teuthology.orchestra.run.smithi107.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 54 kB/s | 8.8 kB 00:00 2020-04-28T12:47:00.992 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:00.993 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:00.994 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:00.994 INFO:teuthology.orchestra.run.smithi107.stdout:(2/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 120 kB/s | 22 kB 00:00 2020-04-28T12:47:00.998 INFO:teuthology.orchestra.run.smithi107.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2020-04-28T12:47:01.037 INFO:teuthology.orchestra.run.smithi107.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 790 kB/s | 34 kB 00:00 2020-04-28T12:47:01.060 INFO:teuthology.orchestra.run.smithi107.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.1 MB/s | 197 kB 00:00 2020-04-28T12:47:01.116 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:01.129 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install cephadm 2020-04-28T12:47:01.507 INFO:teuthology.orchestra.run.smithi107.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 4.8 MB/s | 3.3 MB 00:00 2020-04-28T12:47:01.509 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:01.510 INFO:teuthology.orchestra.run.smithi107.stdout:Total 5.2 MB/s | 3.6 MB 00:00 2020-04-28T12:47:01.514 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:01.523 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:01.523 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:01.594 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:11 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:01.683 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:01.684 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:01.969 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:01.971 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:01.972 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2020-04-28T12:47:01.972 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:01.972 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 41 k 2020-04-28T12:47:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:01.973 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:01.973 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:01.973 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2020-04-28T12:47:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:01.973 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 41 k 2020-04-28T12:47:01.973 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 161 k 2020-04-28T12:47:01.974 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:02.153 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:47:02.202 INFO:teuthology.orchestra.run.smithi026.stdout:cephadm-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 178 kB/s | 41 kB 00:00 2020-04-28T12:47:02.203 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:02.203 INFO:teuthology.orchestra.run.smithi026.stdout:Total 177 kB/s | 41 kB 00:00 2020-04-28T12:47:02.205 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:02.213 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:02.213 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:02.215 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:02.215 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:02.381 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:47:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:02.591 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:47:04.043 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:04.146 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:47:04.319 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:04.539 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:04.539 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:04.540 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:04.540 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:04.540 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:04.540 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:04.666 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:04.681 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-immutable-object-cache 2020-04-28T12:47:05.156 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:15 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:47:05.521 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:05.522 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:05.522 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2020-04-28T12:47:05.522 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:05.523 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:05.523 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 203 k 2020-04-28T12:47:05.523 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:05.523 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:05.523 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:05.523 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2020-04-28T12:47:05.523 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:05.524 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 203 k 2020-04-28T12:47:05.524 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 743 k 2020-04-28T12:47:05.524 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:05.772 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:47:05.822 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-immutable-object-cache-15.2.1-136.ga8c125c 680 kB/s | 203 kB 00:00 2020-04-28T12:47:05.823 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:05.824 INFO:teuthology.orchestra.run.smithi026.stdout:Total 677 kB/s | 203 kB 00:00 2020-04-28T12:47:05.825 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:05.839 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:05.839 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:05.888 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:05.889 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:47:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:47:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:47:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:47:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:47:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:47:06.005 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:06.163 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:47:06.245 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:47:06.245 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:06.246 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:06.246 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:06.246 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:06.246 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:06.246 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:47:06.246 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:47:06.247 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:47:06.247 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:06.247 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:06.369 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:06.382 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:47:06.487 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:47:06.747 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7 1/1 2020-04-28T12:47:06.747 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:06.747 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:06.748 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:06.748 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:06.748 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:06.819 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:17 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:07.011 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:07.026 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr 2020-04-28T12:47:07.195 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:07.197 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: Package ArchVersion Repository Size 2020-04-28T12:47:07.197 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:07.197 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:47:07.198 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:47:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:47:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:47:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:47:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:47:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:47:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:47:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:47:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:07.199 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:07.199 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:07.199 INFO:teuthology.orchestra.run.smithi107.stdout:Install 8 Packages 2020-04-28T12:47:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:07.200 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 37 M 2020-04-28T12:47:07.200 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 205 M 2020-04-28T12:47:07.200 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:07.301 INFO:teuthology.orchestra.run.smithi107.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 42 MB/s | 4.3 MB 00:00 2020-04-28T12:47:07.362 INFO:teuthology.orchestra.run.smithi107.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 62 MB/s | 3.7 MB 00:00 2020-04-28T12:47:07.368 INFO:teuthology.orchestra.run.smithi107.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 42 MB/s | 225 kB 00:00 2020-04-28T12:47:07.382 INFO:teuthology.orchestra.run.smithi107.stdout:(4/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2020-04-28T12:47:07.403 INFO:teuthology.orchestra.run.smithi107.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 31 MB/s | 638 kB 00:00 2020-04-28T12:47:07.412 INFO:teuthology.orchestra.run.smithi107.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 18 MB/s | 169 kB 00:00 2020-04-28T12:47:07.496 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:17 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:07.593 INFO:teuthology.orchestra.run.smithi107.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 65 MB/s | 15 MB 00:00 2020-04-28T12:47:07.773 INFO:teuthology.orchestra.run.smithi026.stdout:Package ceph-mgr-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:07.880 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:07.882 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:07.882 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:08.019 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:08.033 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-dashboard 2020-04-28T12:47:08.500 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:18 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:08.866 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:08.867 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:08.867 INFO:teuthology.orchestra.run.smithi026.stdout: Package ArchVersion Repository Size 2020-04-28T12:47:08.867 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:08.867 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:08.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 3.3 M 2020-04-28T12:47:08.868 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:47:08.868 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 22 k 2020-04-28T12:47:08.868 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.8 k 2020-04-28T12:47:08.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-04-28T12:47:08.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-04-28T12:47:08.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-04-28T12:47:08.868 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:08.869 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:08.869 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:08.869 INFO:teuthology.orchestra.run.smithi026.stdout:Install 6 Packages 2020-04-28T12:47:08.869 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:08.870 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 3.6 M 2020-04-28T12:47:08.870 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 19 M 2020-04-28T12:47:08.870 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:09.193 INFO:teuthology.orchestra.run.smithi026.stdout:(1/6): ceph-prometheus-alerts-15.2.1-136.ga8c12 27 kB/s | 8.8 kB 00:00 2020-04-28T12:47:09.225 INFO:teuthology.orchestra.run.smithi026.stdout:(2/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2020-04-28T12:47:09.264 INFO:teuthology.orchestra.run.smithi026.stdout:(3/6): ceph-grafana-dashboards-15.2.1-136.ga8c1 57 kB/s | 22 kB 00:00 2020-04-28T12:47:09.277 INFO:teuthology.orchestra.run.smithi026.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 663 kB/s | 34 kB 00:00 2020-04-28T12:47:09.326 INFO:teuthology.orchestra.run.smithi026.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.1 MB/s | 197 kB 00:00 2020-04-28T12:47:10.526 INFO:teuthology.orchestra.run.smithi026.stdout:(6/6): ceph-mgr-dashboard-15.2.1-136.ga8c125c7d 2.0 MB/s | 3.3 MB 00:01 2020-04-28T12:47:10.530 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:10.531 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.2 MB/s | 3.6 MB 00:01 2020-04-28T12:47:10.536 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:10.547 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:10.547 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:10.691 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:10.691 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:10.967 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:11.155 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2020-04-28T12:47:11.357 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2020-04-28T12:47:11.545 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2020-04-28T12:47:11.654 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 4/6 2020-04-28T12:47:12.419 INFO:teuthology.orchestra.run.smithi107.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 1.6 MB/s | 8.6 MB 00:05 2020-04-28T12:47:12.422 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:12.422 INFO:teuthology.orchestra.run.smithi107.stdout:Total 7.0 MB/s | 37 MB 00:05 2020-04-28T12:47:12.434 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:12.453 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:12.454 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:12.722 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 5/6 2020-04-28T12:47:12.773 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:12.774 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:13.445 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:47:13.603 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:47:13.753 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:47:13.884 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:47:14.324 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:47:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:47:14.625 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 6/6 2020-04-28T12:47:14.625 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8 1/6 2020-04-28T12:47:14.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noar 2/6 2020-04-28T12:47:14.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8. 3/6 2020-04-28T12:47:14.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2020-04-28T12:47:14.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2020-04-28T12:47:15.014 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:47:15.236 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:47:15.347 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2020-04-28T12:47:15.347 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:15.347 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:15.347 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:15.347 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:15.348 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:15.348 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-04-28T12:47:15.348 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-04-28T12:47:15.348 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2020-04-28T12:47:15.348 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:15.348 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:15.488 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:15.502 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-diskprediction-local 2020-04-28T12:47:15.921 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:47:15.968 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:25 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:16.240 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:47:16.365 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:16.366 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:16.367 INFO:teuthology.orchestra.run.smithi026.stdout: Package ArchVersion Repository Size 2020-04-28T12:47:16.367 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:16.367 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:16.367 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 8.6 M 2020-04-28T12:47:16.367 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:47:16.367 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-04-28T12:47:16.367 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-04-28T12:47:16.368 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-04-28T12:47:16.368 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-04-28T12:47:16.368 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-04-28T12:47:16.368 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-04-28T12:47:16.368 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-04-28T12:47:16.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:16.368 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:16.369 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:16.369 INFO:teuthology.orchestra.run.smithi026.stdout:Install 8 Packages 2020-04-28T12:47:16.369 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:16.369 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 37 M 2020-04-28T12:47:16.370 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 205 M 2020-04-28T12:47:16.370 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:16.461 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:47:16.476 INFO:teuthology.orchestra.run.smithi026.stdout:(1/8): openblas-0.3.3-2.el8.x86_64.rpm 40 MB/s | 4.3 MB 00:00 2020-04-28T12:47:16.530 INFO:teuthology.orchestra.run.smithi026.stdout:(2/8): openblas-threads-0.3.3-2.el8.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2020-04-28T12:47:16.538 INFO:teuthology.orchestra.run.smithi026.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 27 MB/s | 225 kB 00:00 2020-04-28T12:47:16.549 INFO:teuthology.orchestra.run.smithi026.stdout:(4/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 51 MB/s | 3.7 MB 00:00 2020-04-28T12:47:16.562 INFO:teuthology.orchestra.run.smithi026.stdout:(5/8): libgfortran-8.3.1-4.5.el8.x86_64.rpm 51 MB/s | 638 kB 00:00 2020-04-28T12:47:16.567 INFO:teuthology.orchestra.run.smithi026.stdout:(6/8): libquadmath-8.3.1-4.5.el8.x86_64.rpm 35 MB/s | 169 kB 00:00 2020-04-28T12:47:16.796 INFO:teuthology.orchestra.run.smithi026.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.1.0+24 56 MB/s | 15 MB 00:00 2020-04-28T12:47:17.079 INFO:teuthology.orchestra.run.smithi026.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.1-136 12 MB/s | 8.6 MB 00:00 2020-04-28T12:47:17.082 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:17.082 INFO:teuthology.orchestra.run.smithi026.stdout:Total 51 MB/s | 37 MB 00:00 2020-04-28T12:47:17.094 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:17.114 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:17.114 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:17.454 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:17.454 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:18.006 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:18.170 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:47:18.306 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 1/8 2020-04-28T12:47:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:47:18.503 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:47:19.066 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 2/8 2020-04-28T12:47:19.220 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:47:19.726 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:47:19.799 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:47:19.928 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:47:19.935 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:47:20.269 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:47:20.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:47:20.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:47:20.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:47:20.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:47:20.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:47:20.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:47:20.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:47:20.669 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 4/8 2020-04-28T12:47:20.962 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:47:21.150 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:47:21.150 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:21.151 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:21.151 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:21.151 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:47:21.151 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:47:21.151 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:47:21.151 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:47:21.152 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:47:21.152 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:47:21.152 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:47:21.152 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:21.152 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:21.194 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:47:21.282 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:21.295 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:47:21.733 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:32 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:22.099 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:22.101 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:22.101 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2020-04-28T12:47:22.101 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:22.102 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:47:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-noarch 27 k 2020-04-28T12:47:22.102 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:47:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:47:22.102 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:47:22.103 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:47:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:47:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:47:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:22.104 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:22.104 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:22.104 INFO:teuthology.orchestra.run.smithi107.stdout:Install 13 Packages 2020-04-28T12:47:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:22.106 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 1.9 M 2020-04-28T12:47:22.106 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 23 M 2020-04-28T12:47:22.106 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:22.134 INFO:teuthology.orchestra.run.smithi107.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 899 kB/s | 27 kB 00:00 2020-04-28T12:47:22.138 INFO:teuthology.orchestra.run.smithi107.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 34 MB/s | 126 kB 00:00 2020-04-28T12:47:22.138 INFO:teuthology.orchestra.run.smithi107.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 592 kB/s | 20 kB 00:00 2020-04-28T12:47:22.141 INFO:teuthology.orchestra.run.smithi107.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 41 MB/s | 110 kB 00:00 2020-04-28T12:47:22.147 INFO:teuthology.orchestra.run.smithi107.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 19 MB/s | 155 kB 00:00 2020-04-28T12:47:22.147 INFO:teuthology.orchestra.run.smithi107.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 7.1 MB/s | 43 kB 00:00 2020-04-28T12:47:22.193 INFO:teuthology.orchestra.run.smithi107.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 351 kB/s | 16 kB 00:00 2020-04-28T12:47:22.203 INFO:teuthology.orchestra.run.smithi107.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 582 kB/s | 33 kB 00:00 2020-04-28T12:47:22.239 INFO:teuthology.orchestra.run.smithi107.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 1.7 MB/s | 81 kB 00:00 2020-04-28T12:47:22.256 INFO:teuthology.orchestra.run.smithi107.stdout:(10/13): python3-rsa-3.4.2-12.el8.noarch.rpm 4.4 MB/s | 73 kB 00:00 2020-04-28T12:47:22.272 INFO:teuthology.orchestra.run.smithi107.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.8 MB/s | 61 kB 00:00 2020-04-28T12:47:22.292 INFO:teuthology.orchestra.run.smithi107.stdout:(12/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.e 145 kB/s | 27 kB 00:00 2020-04-28T12:47:22.300 INFO:teuthology.orchestra.run.smithi107.stdout:(13/13): python3-kubernetes-10.0.1-2.el8.noarch 11 MB/s | 1.1 MB 00:00 2020-04-28T12:47:22.302 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:22.302 INFO:teuthology.orchestra.run.smithi107.stdout:Total 9.4 MB/s | 1.9 MB 00:00 2020-04-28T12:47:22.309 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:22.325 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:22.325 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:22.394 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:22.394 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:22.897 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:47:23.305 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2020-04-28T12:47:23.439 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:47:23.646 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:47:23.858 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:47:24.041 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:47:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:47:24.505 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:47:24.632 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 7/8 2020-04-28T12:47:24.705 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:47:24.827 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:47:25.063 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 8/8 2020-04-28T12:47:25.063 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7 1/8 2020-04-28T12:47:25.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 2/8 2020-04-28T12:47:25.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 3/8 2020-04-28T12:47:25.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2020-04-28T12:47:25.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2020-04-28T12:47:25.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x 6/8 2020-04-28T12:47:25.064 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 7/8 2020-04-28T12:47:25.629 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 8/8 2020-04-28T12:47:25.629 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:25.629 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:25.629 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:25.629 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.3-2.el8.x86_64 2020-04-28T12:47:25.630 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-04-28T12:47:25.630 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-04-28T12:47:25.630 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-04-28T12:47:25.630 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-04-28T12:47:25.630 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-04-28T12:47:25.630 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-04-28T12:47:25.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:25.631 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:25.744 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:25.745 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:47:25.759 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-rook 2020-04-28T12:47:26.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:47:26.227 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:36 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:47:26.614 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:26.617 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:26.617 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2020-04-28T12:47:26.617 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:26.617 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:26.617 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:47:26.618 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-noarch 27 k 2020-04-28T12:47:26.618 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:47:26.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2020-04-28T12:47:26.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2020-04-28T12:47:26.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2020-04-28T12:47:26.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2020-04-28T12:47:26.618 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2020-04-28T12:47:26.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2020-04-28T12:47:26.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-04-28T12:47:26.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-04-28T12:47:26.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-04-28T12:47:26.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 10.0.1-2.el8 epel 1.1 M 2020-04-28T12:47:26.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 3.4.2-12.el8 epel 73 k 2020-04-28T12:47:26.619 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-04-28T12:47:26.620 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:26.620 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:26.620 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:26.620 INFO:teuthology.orchestra.run.smithi026.stdout:Install 13 Packages 2020-04-28T12:47:26.620 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:26.621 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.9 M 2020-04-28T12:47:26.621 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 23 M 2020-04-28T12:47:26.621 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:26.650 INFO:teuthology.orchestra.run.smithi026.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 871 kB/s | 27 kB 00:00 2020-04-28T12:47:26.654 INFO:teuthology.orchestra.run.smithi026.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 37 MB/s | 126 kB 00:00 2020-04-28T12:47:26.655 INFO:teuthology.orchestra.run.smithi026.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 574 kB/s | 20 kB 00:00 2020-04-28T12:47:26.657 INFO:teuthology.orchestra.run.smithi026.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 37 MB/s | 110 kB 00:00 2020-04-28T12:47:26.659 INFO:teuthology.orchestra.run.smithi026.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 28 MB/s | 43 kB 00:00 2020-04-28T12:47:26.659 INFO:teuthology.orchestra.run.smithi026.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 35 MB/s | 155 kB 00:00 2020-04-28T12:47:26.706 INFO:teuthology.orchestra.run.smithi026.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 348 kB/s | 16 kB 00:00 2020-04-28T12:47:26.716 INFO:teuthology.orchestra.run.smithi026.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 572 kB/s | 33 kB 00:00 2020-04-28T12:47:26.741 INFO:teuthology.orchestra.run.smithi026.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 2.3 MB/s | 81 kB 00:00 2020-04-28T12:47:26.758 INFO:teuthology.orchestra.run.smithi026.stdout:(10/13): python3-rsa-3.4.2-12.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-04-28T12:47:26.767 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:47:26.774 INFO:teuthology.orchestra.run.smithi026.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.8 MB/s | 61 kB 00:00 2020-04-28T12:47:26.831 INFO:teuthology.orchestra.run.smithi026.stdout:(12/13): python3-kubernetes-10.0.1-2.el8.noarch 9.7 MB/s | 1.1 MB 00:00 2020-04-28T12:47:26.925 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:47:26.998 INFO:teuthology.orchestra.run.smithi026.stdout:(13/13): ceph-mgr-rook-15.2.1-136.ga8c125c7d7.e 72 kB/s | 27 kB 00:00 2020-04-28T12:47:26.998 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:26.999 INFO:teuthology.orchestra.run.smithi026.stdout:Total 4.9 MB/s | 1.9 MB 00:00 2020-04-28T12:47:27.007 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:27.023 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:27.023 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:27.145 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:27.145 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:47:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:47:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:47:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:47:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:47:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:47:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:47:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:47:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:47:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:47:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:47:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:47:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:47:27.482 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:47:27.483 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:27.483 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:27.483 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:27.483 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:47:27.484 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:47:27.484 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:47:27.484 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:47:27.484 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:47:27.485 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:47:27.485 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:47:27.485 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:47:27.485 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:47:27.486 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:47:27.486 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:47:27.486 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:47:27.487 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:27.488 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:27.616 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:27.631 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:47:27.655 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:27.950 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2020-04-28T12:47:28.069 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:39 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:28.202 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2020-04-28T12:47:28.407 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 3/13 2020-04-28T12:47:28.431 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:28.432 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:28.432 INFO:teuthology.orchestra.run.smithi107.stdout: Package ArchVersion Repository Size 2020-04-28T12:47:28.432 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:28.432 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:28.432 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:47:28.433 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:47:28.433 INFO:teuthology.orchestra.run.smithi107.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:47:28.433 INFO:teuthology.orchestra.run.smithi107.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:47:28.433 INFO:teuthology.orchestra.run.smithi107.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:47:28.433 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:28.433 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:28.433 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:28.434 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2020-04-28T12:47:28.434 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:28.434 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 467 k 2020-04-28T12:47:28.434 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 1.4 M 2020-04-28T12:47:28.435 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:28.486 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 937 kB/s | 48 kB 00:00 2020-04-28T12:47:28.498 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 5.4 MB/s | 356 kB 00:00 2020-04-28T12:47:28.542 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 375 kB/s | 21 kB 00:00 2020-04-28T12:47:28.660 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 184 kB/s | 42 kB 00:00 2020-04-28T12:47:28.661 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:28.662 INFO:teuthology.orchestra.run.smithi107.stdout:Total 2.0 MB/s | 467 kB 00:00 2020-04-28T12:47:28.665 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:28.672 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:28.672 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:28.695 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:28.696 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:28.735 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2020-04-28T12:47:28.871 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:28.936 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2020-04-28T12:47:29.109 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:47:29.188 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2020-04-28T12:47:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:47:29.485 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2020-04-28T12:47:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:47:29.708 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:47:29.718 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2020-04-28T12:47:29.910 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:47:29.910 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:47:29.911 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:47:29.911 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:47:30.167 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:47:30.167 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:30.168 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:30.168 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:30.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:47:30.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:47:30.168 INFO:teuthology.orchestra.run.smithi107.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:47:30.168 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:30.168 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:30.332 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:30.345 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-fuse 2020-04-28T12:47:30.785 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:41 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:30.838 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2020-04-28T12:47:31.156 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:31.157 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2020-04-28T12:47:31.157 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:31.157 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:31.157 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:47:31.157 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2020-04-28T12:47:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:47:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:47:31.158 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:31.158 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:31.158 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:31.158 INFO:teuthology.orchestra.run.smithi107.stdout:Install 3 Packages 2020-04-28T12:47:31.159 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:31.159 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 676 k 2020-04-28T12:47:31.159 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 2.1 M 2020-04-28T12:47:31.159 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:31.189 INFO:teuthology.orchestra.run.smithi107.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2020-04-28T12:47:31.193 INFO:teuthology.orchestra.run.smithi107.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 615 kB/s | 21 kB 00:00 2020-04-28T12:47:31.491 INFO:teuthology.orchestra.run.smithi107.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 1.7 MB/s | 572 kB 00:00 2020-04-28T12:47:31.492 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:31.493 INFO:teuthology.orchestra.run.smithi107.stdout:Total 2.0 MB/s | 676 kB 00:00 2020-04-28T12:47:31.503 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:31.517 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:31.517 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:31.580 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:31.580 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:31.770 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:31.770 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:47:31.770 INFO:teuthology.orchestra.run.smithi107.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:47:31.770 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:32.185 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-10.0.1-2.el8.noarch 10/13 2020-04-28T12:47:32.377 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2020-04-28T12:47:32.535 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2020-04-28T12:47:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:47:32.731 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:47:32.826 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:47:33.007 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:47:33.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:47:33.007 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:47:33.082 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 13/13 2020-04-28T12:47:33.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/13 2020-04-28T12:47:33.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2020-04-28T12:47:33.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2020-04-28T12:47:33.082 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2020-04-28T12:47:33.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2020-04-28T12:47:33.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2020-04-28T12:47:33.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2020-04-28T12:47:33.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2020-04-28T12:47:33.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2020-04-28T12:47:33.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2020-04-28T12:47:33.083 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-10.0.1-2.el8.noarch 11/13 2020-04-28T12:47:33.084 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 12/13 2020-04-28T12:47:33.289 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:47:33.289 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:33.290 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:33.290 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:47:33.290 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:47:33.290 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:33.290 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:33.510 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2020-04-28T12:47:33.511 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:33.511 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:33.511 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:33.511 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-04-28T12:47:33.511 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-04-28T12:47:33.511 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-04-28T12:47:33.511 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-04-28T12:47:33.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-04-28T12:47:33.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-04-28T12:47:33.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-04-28T12:47:33.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-04-28T12:47:33.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-04-28T12:47:33.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-10.0.1-2.el8.noarch 2020-04-28T12:47:33.512 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-04-28T12:47:33.513 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-04-28T12:47:33.513 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:33.513 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:33.605 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:33.615 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:33.619 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install librados-devel 2020-04-28T12:47:33.629 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-mgr-cephadm 2020-04-28T12:47:34.065 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:45 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:34.111 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:44 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:34.486 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:34.487 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:34.487 INFO:teuthology.orchestra.run.smithi026.stdout: Package ArchVersion Repository Size 2020-04-28T12:47:34.487 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:34.487 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:34.487 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch2:15.2.1-136.ga8c125c7d7.el8 ceph-noarch 42 k 2020-04-28T12:47:34.488 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:47:34.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-04-28T12:47:34.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-04-28T12:47:34.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-04-28T12:47:34.488 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:34.488 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:34.488 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:34.489 INFO:teuthology.orchestra.run.smithi026.stdout:Install 4 Packages 2020-04-28T12:47:34.489 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:34.489 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 467 k 2020-04-28T12:47:34.489 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 1.4 M 2020-04-28T12:47:34.490 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:34.507 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:34.508 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:34.508 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2020-04-28T12:47:34.508 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:34.508 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:34.509 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:47:34.509 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:34.509 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:34.509 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:34.509 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-04-28T12:47:34.509 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:34.510 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 141 k 2020-04-28T12:47:34.510 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 487 k 2020-04-28T12:47:34.511 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:34.550 INFO:teuthology.orchestra.run.smithi026.stdout:(1/4): python3-remoto-1.1.4-4.el8.noarch.rpm 842 kB/s | 48 kB 00:00 2020-04-28T12:47:34.560 INFO:teuthology.orchestra.run.smithi026.stdout:(2/4): python3-execnet-1.7.1-1.el8.2.noarch.rpm 4.9 MB/s | 356 kB 00:00 2020-04-28T12:47:34.595 INFO:teuthology.orchestra.run.smithi026.stdout:(3/4): python3-apipkg-1.5-6.el8.noarch.rpm 451 kB/s | 21 kB 00:00 2020-04-28T12:47:34.712 INFO:teuthology.orchestra.run.smithi026.stdout:(4/4): ceph-mgr-cephadm-15.2.1-136.ga8c125c7d7. 186 kB/s | 42 kB 00:00 2020-04-28T12:47:34.715 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:34.715 INFO:teuthology.orchestra.run.smithi026.stdout:Total 2.0 MB/s | 467 kB 00:00 2020-04-28T12:47:34.718 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:34.726 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:34.726 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:34.759 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:34.759 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:34.769 INFO:teuthology.orchestra.run.smithi107.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 542 kB/s | 141 kB 00:00 2020-04-28T12:47:34.770 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:34.770 INFO:teuthology.orchestra.run.smithi107.stdout:Total 539 kB/s | 141 kB 00:00 2020-04-28T12:47:34.772 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:34.778 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:34.779 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:34.827 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:34.827 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:34.938 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:34.940 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:35.121 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:35.142 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/4 2020-04-28T12:47:35.335 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:35.398 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:47:35.549 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:47:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:35.623 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:35.623 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:35.717 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:47:35.905 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:35.919 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs2 2020-04-28T12:47:35.931 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 4/4 2020-04-28T12:47:35.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 1/4 2020-04-28T12:47:35.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 2/4 2020-04-28T12:47:35.931 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 3/4 2020-04-28T12:47:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/4 2020-04-28T12:47:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:36.209 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:15.2.1-136.ga8c125c7d7.el8.noarch 2020-04-28T12:47:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-04-28T12:47:36.209 INFO:teuthology.orchestra.run.smithi026.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-04-28T12:47:36.210 INFO:teuthology.orchestra.run.smithi026.stdout: python3-apipkg-1.5-6.el8.noarch 2020-04-28T12:47:36.210 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:36.210 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:36.325 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:36.338 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-fuse 2020-04-28T12:47:36.364 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:47 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:36.617 INFO:teuthology.orchestra.run.smithi107.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:36.719 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:36.720 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:47:36.720 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:36.816 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:46 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:36.878 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:36.892 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install libcephfs-devel 2020-04-28T12:47:37.199 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:37.199 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2020-04-28T12:47:37.200 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:37.200 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:37.200 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 572 k 2020-04-28T12:47:37.200 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:47:37.200 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2020-04-28T12:47:37.200 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2020-04-28T12:47:37.200 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:37.201 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:37.201 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:37.201 INFO:teuthology.orchestra.run.smithi026.stdout:Install 3 Packages 2020-04-28T12:47:37.201 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:37.201 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 676 k 2020-04-28T12:47:37.201 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 2.1 M 2020-04-28T12:47:37.201 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:37.231 INFO:teuthology.orchestra.run.smithi026.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.6 MB/s | 82 kB 00:00 2020-04-28T12:47:37.234 INFO:teuthology.orchestra.run.smithi026.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 614 kB/s | 21 kB 00:00 2020-04-28T12:47:37.331 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:48 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:37.620 INFO:teuthology.orchestra.run.smithi026.stdout:(3/3): ceph-fuse-15.2.1-136.ga8c125c7d7.el8.x86 1.3 MB/s | 572 kB 00:00 2020-04-28T12:47:37.622 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:37.622 INFO:teuthology.orchestra.run.smithi026.stdout:Total 1.6 MB/s | 676 kB 00:00 2020-04-28T12:47:37.627 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:37.650 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:37.651 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:37.722 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:37.723 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:37.761 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:37.762 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2020-04-28T12:47:37.762 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:37.762 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:47:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:37.763 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:37.763 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:37.763 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-04-28T12:47:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:37.764 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 21 k 2020-04-28T12:47:37.764 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 76 k 2020-04-28T12:47:37.764 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:37.951 INFO:teuthology.orchestra.run.smithi107.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 113 kB/s | 21 kB 00:00 2020-04-28T12:47:37.952 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:37.952 INFO:teuthology.orchestra.run.smithi107.stdout:Total 113 kB/s | 21 kB 00:00 2020-04-28T12:47:37.954 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:37.958 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:37.958 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:37.960 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:37.960 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:38.031 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:38.041 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:38.041 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2020-04-28T12:47:38.041 INFO:teuthology.orchestra.run.smithi026.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-04-28T12:47:38.041 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:38.187 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:38.481 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:47:38.608 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:47:38.634 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:38.634 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:38.634 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:38.634 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:38.635 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:38.635 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:38.761 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:38.774 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install librados2 2020-04-28T12:47:38.922 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 3/3 2020-04-28T12:47:38.922 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/3 2020-04-28T12:47:38.923 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2020-04-28T12:47:39.203 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2020-04-28T12:47:39.204 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:39.204 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:39.204 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2020-04-28T12:47:39.204 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-04-28T12:47:39.204 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:39.205 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:39.214 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:50 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:39.450 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:39.458 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:39.464 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install librados-devel 2020-04-28T12:47:39.561 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:47:39.562 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:39.719 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:39.733 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install librbd1 2020-04-28T12:47:39.937 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:49 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:40.173 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:51 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:40.302 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:40.303 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2020-04-28T12:47:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:40.303 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:40.303 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:47:40.303 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2020-04-28T12:47:40.304 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 141 k 2020-04-28T12:47:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 487 k 2020-04-28T12:47:40.304 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:40.416 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:40.519 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:40.520 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:47:40.520 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:librados-devel-15.2.1-136.ga8c125c7d7.el8.x86_6 538 kB/s | 141 kB 00:00 2020-04-28T12:47:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:40.571 INFO:teuthology.orchestra.run.smithi026.stdout:Total 536 kB/s | 141 kB 00:00 2020-04-28T12:47:40.572 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:40.575 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:40.575 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:40.628 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:40.629 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:40.654 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:40.668 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rados 2020-04-28T12:47:40.742 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:40.931 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:41.109 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:52 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:41.148 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:41.410 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:41.484 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:41.484 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:41.485 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:41.485 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:41.485 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:41.485 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:41.512 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:41.513 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:47:41.513 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:41.646 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:41.659 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rgw 2020-04-28T12:47:41.709 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:41.725 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs2 2020-04-28T12:47:42.097 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:53 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:42.195 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:52 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:42.351 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:42.454 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:42.455 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:47:42.455 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:42.459 INFO:teuthology.orchestra.run.smithi026.stdout:Package libcephfs2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:42.566 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:42.568 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:42.568 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:42.611 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:42.624 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-cephfs 2020-04-28T12:47:42.697 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:42.711 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install libcephfs-devel 2020-04-28T12:47:43.066 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:54 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:43.183 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:53 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:43.316 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:43.418 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:43.419 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:47:43.420 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:43.557 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:43.570 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install python3-rbd 2020-04-28T12:47:43.599 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:43.600 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:43.600 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2020-04-28T12:47:43.600 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:43.600 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:43.600 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 21 k 2020-04-28T12:47:43.601 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:43.601 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:43.601 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:43.601 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2020-04-28T12:47:43.601 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:43.601 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 21 k 2020-04-28T12:47:43.601 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 76 k 2020-04-28T12:47:43.602 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:43.789 INFO:teuthology.orchestra.run.smithi026.stdout:libcephfs-devel-15.2.1-136.ga8c125c7d7.el8.x86_ 113 kB/s | 21 kB 00:00 2020-04-28T12:47:43.789 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:43.790 INFO:teuthology.orchestra.run.smithi026.stdout:Total 113 kB/s | 21 kB 00:00 2020-04-28T12:47:43.792 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:43.796 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:43.796 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:43.798 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:43.799 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:43.847 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:44.011 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:55 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:44.022 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:44.214 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:44.266 INFO:teuthology.orchestra.run.smithi107.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:44.369 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:44.370 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2020-04-28T12:47:44.370 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:44.483 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:44.483 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:44.483 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:44.484 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:44.484 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:44.484 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:44.529 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:44.542 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-fuse 2020-04-28T12:47:44.600 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:44.614 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install librados2 2020-04-28T12:47:44.983 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:55 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:45.087 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:55 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:45.345 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:45.345 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:45.345 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2020-04-28T12:47:45.346 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:45.346 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:45.346 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:47:45.346 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:45.346 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:45.346 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:45.347 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-04-28T12:47:45.347 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:45.347 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 72 k 2020-04-28T12:47:45.347 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 230 k 2020-04-28T12:47:45.348 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:45.358 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:45.466 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:45.467 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:45.468 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:45.571 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 322 kB/s | 72 kB 00:00 2020-04-28T12:47:45.572 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:45.572 INFO:teuthology.orchestra.run.smithi107.stdout:Total 320 kB/s | 72 kB 00:00 2020-04-28T12:47:45.574 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:45.585 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:45.585 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:45.611 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:45.624 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install librbd1 2020-04-28T12:47:45.633 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:45.634 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:45.894 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:46.095 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:56 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:46.095 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:46.345 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:46.345 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:46.458 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:46.459 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:46.564 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:46.582 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rados 2020-04-28T12:47:46.621 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:46.634 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-mirror 2020-04-28T12:47:47.053 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:57 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:47.080 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:01:58 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:47.308 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rados-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:47.419 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:47.419 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:47.419 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:47.451 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:47.452 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:47.452 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repo Size 2020-04-28T12:47:47.452 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:47.452 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:47.452 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:47:47.453 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:47.453 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:47.453 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:47.453 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-04-28T12:47:47.453 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:47.453 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.7 M 2020-04-28T12:47:47.453 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 13 M 2020-04-28T12:47:47.454 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:47.545 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:47.559 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rgw 2020-04-28T12:47:47.945 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 5.5 MB/s | 2.7 MB 00:00 2020-04-28T12:47:47.946 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:47.946 INFO:teuthology.orchestra.run.smithi107.stdout:Total 5.5 MB/s | 2.7 MB 00:00 2020-04-28T12:47:47.949 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:47.964 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:47.964 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:48.026 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:48.026 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:48.029 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:58 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:48.356 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rgw-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:48.464 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:48.466 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:48.466 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:48.597 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:48.611 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-cephfs 2020-04-28T12:47:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:49.085 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:59 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:49.087 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:49.341 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-cephfs-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:49.398 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:49.449 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:49.451 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:49.451 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:49.561 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:49.575 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install python3-rbd 2020-04-28T12:47:49.652 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:49.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:49.653 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:49.653 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:49.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:49.653 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:49.946 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:49.960 INFO:teuthology.orchestra.run.smithi107:> sudo yum -y install rbd-nbd 2020-04-28T12:47:50.045 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:00 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:50.316 INFO:teuthology.orchestra.run.smithi026.stdout:Package python3-rbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 is already installed. 2020-04-28T12:47:50.412 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:02:01 ago on Tue 28 Apr 2020 12:45:49 PM UTC. 2020-04-28T12:47:50.426 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:50.429 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2020-04-28T12:47:50.429 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:50.560 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:50.576 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-fuse 2020-04-28T12:47:50.795 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2020-04-28T12:47:50.796 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2020-04-28T12:47:50.796 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:50.796 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2020-04-28T12:47:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:47:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:50.797 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2020-04-28T12:47:50.797 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2020-04-28T12:47:50.797 INFO:teuthology.orchestra.run.smithi107.stdout:Install 1 Package 2020-04-28T12:47:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:50.798 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 141 k 2020-04-28T12:47:50.798 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 526 k 2020-04-28T12:47:50.798 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2020-04-28T12:47:51.050 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:01 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:51.057 INFO:teuthology.orchestra.run.smithi107.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 540 kB/s | 141 kB 00:00 2020-04-28T12:47:51.058 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:51.058 INFO:teuthology.orchestra.run.smithi107.stdout:Total 538 kB/s | 141 kB 00:00 2020-04-28T12:47:51.060 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2020-04-28T12:47:51.074 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2020-04-28T12:47:51.074 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2020-04-28T12:47:51.120 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2020-04-28T12:47:51.120 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2020-04-28T12:47:51.236 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2020-04-28T12:47:51.401 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:51.453 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:51.453 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:51.453 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2020-04-28T12:47:51.454 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:51.454 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:51.454 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 72 k 2020-04-28T12:47:51.454 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:51.454 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:51.454 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:51.455 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2020-04-28T12:47:51.455 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:51.455 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 72 k 2020-04-28T12:47:51.455 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 230 k 2020-04-28T12:47:51.455 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:51.678 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-fuse-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 322 kB/s | 72 kB 00:00 2020-04-28T12:47:51.678 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:51.678 INFO:teuthology.orchestra.run.smithi026.stdout:Total 321 kB/s | 72 kB 00:00 2020-04-28T12:47:51.680 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:51.692 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:51.692 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:51.744 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:51.744 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:51.849 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:51.860 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:51.860 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:51.860 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2020-04-28T12:47:51.861 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:51.861 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:47:51.861 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2020-04-28T12:47:51.996 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:52.129 DEBUG:teuthology.parallel:result is None 2020-04-28T12:47:52.208 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:52.474 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:52.475 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:52.475 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:52.475 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:52.475 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:52.475 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:52.749 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:52.762 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-mirror 2020-04-28T12:47:53.234 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:03 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:54.118 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:54.119 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:54.119 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repo Size 2020-04-28T12:47:54.119 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:54.119 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:54.119 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 2.7 M 2020-04-28T12:47:54.120 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:54.120 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:54.120 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:54.120 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2020-04-28T12:47:54.120 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:54.121 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 2.7 M 2020-04-28T12:47:54.121 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 13 M 2020-04-28T12:47:54.121 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:54.577 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-mirror-15.2.1-136.ga8c125c7d7.el8.x86_64.rp 5.9 MB/s | 2.7 MB 00:00 2020-04-28T12:47:54.578 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:54.579 INFO:teuthology.orchestra.run.smithi026.stdout:Total 5.9 MB/s | 2.7 MB 00:00 2020-04-28T12:47:54.581 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:54.597 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:54.597 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:54.663 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:54.663 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:55.329 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:55.623 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:55.966 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:56.232 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:56.232 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:56.232 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:56.232 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:56.233 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:56.233 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:56.499 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:56.513 INFO:teuthology.orchestra.run.smithi026:> sudo yum -y install rbd-nbd 2020-04-28T12:47:56.993 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:02:06 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:47:57.367 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:47:57.367 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:57.368 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2020-04-28T12:47:57.368 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:57.368 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:47:57.368 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:15.2.1-136.ga8c125c7d7.el8 ceph 141 k 2020-04-28T12:47:57.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:57.368 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:47:57.368 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:47:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:Install 1 Package 2020-04-28T12:47:57.369 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 141 k 2020-04-28T12:47:57.369 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 526 k 2020-04-28T12:47:57.370 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:47:57.629 INFO:teuthology.orchestra.run.smithi026.stdout:rbd-nbd-15.2.1-136.ga8c125c7d7.el8.x86_64.rpm 542 kB/s | 141 kB 00:00 2020-04-28T12:47:57.630 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:47:57.630 INFO:teuthology.orchestra.run.smithi026.stdout:Total 540 kB/s | 141 kB 00:00 2020-04-28T12:47:57.632 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:47:57.644 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:47:57.644 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:47:57.697 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:47:57.697 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:47:57.815 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:47:58.012 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:58.228 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:58.490 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 1/1 2020-04-28T12:47:58.490 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:58.490 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:47:58.491 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:15.2.1-136.ga8c125c7d7.el8.x86_64 2020-04-28T12:47:58.491 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:47:58.491 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:47:58.731 DEBUG:teuthology.parallel:result is None 2020-04-28T12:47:58.731 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:58.748 INFO:teuthology.orchestra.run.smithi026:> sudo lsb_release -is 2020-04-28T12:47:58.830 INFO:teuthology.orchestra.run.smithi026.stdout:CentOS 2020-04-28T12:47:58.831 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:47:58.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:47:59.154 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:59.168 INFO:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:47:59.228 INFO:teuthology.orchestra.run.smithi026.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:47:59.228 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:47:59.229 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:47:59.229 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:59.246 INFO:teuthology.orchestra.run.smithi107:> sudo lsb_release -is 2020-04-28T12:47:59.335 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS 2020-04-28T12:47:59.335 DEBUG:teuthology.misc:System to be installed: CentOS 2020-04-28T12:47:59.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:47:59.627 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:59.646 INFO:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-04-28T12:47:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:47:59.715 INFO:teuthology.packaging:The installed version of ceph is 15.2.1-136.ga8c125c7d7.el8 2020-04-28T12:47:59.716 INFO:teuthology.task.install:The correct ceph version 15.2.1-136.ga8c125c7d7 is installed. 2020-04-28T12:47:59.716 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-04-28T12:47:59.716 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:59.735 INFO:teuthology.orchestra.run.smithi026:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:47:59.812 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:47:59.828 INFO:teuthology.orchestra.run.smithi107:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-04-28T12:47:59.900 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-04-28T12:47:59.900 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:47:59.917 INFO:teuthology.orchestra.run.smithi026:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:47:59.994 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:00.050 INFO:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:48:00.123 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:00.139 INFO:teuthology.orchestra.run.smithi107:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-04-28T12:48:00.212 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:00.267 INFO:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-04-28T12:48:00.337 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-04-28T12:48:00.337 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:00.355 INFO:teuthology.orchestra.run.smithi026:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:48:00.441 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:00.496 INFO:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:48:00.570 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:00.587 INFO:teuthology.orchestra.run.smithi107:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-04-28T12:48:00.672 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:00.727 INFO:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-04-28T12:48:00.796 INFO:teuthology.run_tasks:Running task ceph... 2020-04-28T12:48:00.863 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-04-28T12:48:00.863 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:00.880 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2020-04-28T12:48:00.922 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:00.937 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2020-04-28T12:48:01.005 INFO:tasks.ceph:Disabling ceph logrotate... 2020-04-28T12:48:01.005 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:01.027 INFO:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:48:01.069 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:01.084 INFO:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2020-04-28T12:48:01.152 INFO:tasks.ceph:Creating extra log directories... 2020-04-28T12:48:01.152 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:01.167 INFO:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:48:01.215 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:01.228 INFO:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-04-28T12:48:01.297 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-04-28T12:48:01.297 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_min_pg_log_entries': 10, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 20, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'lockdep': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1, 'lockdep': True}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}} 2020-04-28T12:48:01.297 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_octopus/qa', 'sleep_before_teardown': 0, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.22126', 'owner': 'scheduled_teuthology@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi026.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtIFPOLrhvQWoDT8OfhzGSwQwKQbNsaQV7bgUylZj1TolbBM5+RgV0r4kvRjlTnMrkEr1FHsfi3BjB4urE0eBiWASiQIFrawLLgyyzEUazX5fv2lDNMVWsDA3U3008kjWoDXDnaS+3nxXsMg8y6ljpq0iByKeMsReZlXDcr2hwmwd+yG58Sfu8FWd4Gjd2n4Wkl7Q4FS4FUWxNjRETkgErzeUGBhkPFGj77/SAzoEOKuqkGjqXjIuHYLQ2Fw5/bc+q1LR20kIh51GYI8pRThKOv4UFqkZFTrhTsA0pfc0HPYJr/bQc5zIFxpmLnVIizQgI5PthHzZUSnYUNrZUogyAuyNMUUJ0GFaNeZXDKk9BOM25wL5LdGHfxEaQgFfyBFfZ12cWzugAkBXqjNyxusIHaa39Cf/gTQ27BH2AzgpMBs6eNRxPnvOQKKbgtxBhZ625qGBSwt5LDlCKZYg560t5pucPejyDrdvYSZTdA7u+ypIIWDWUR/WLD7KoDJHJaBs=', 'smithi107.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9P0wjo/erkimMEJ+rTtKsfh7avWGKVURM5ANfgCWU9QIytCE806FICjvXd3haR6NlCNYmMxcTsBjTnBk5pjtigoMm0DloZsxB7FBmun8XBYGC4DaCujIfqfFC732bCNl9vdV7h7RxkYBz3RCPVOtOUeigcsIeXF3ASn1CTF6Lyf+Hjvy3xY8L/2GC4qV9nXF47Nl3JkHyiP+mRrXiklHMt+SMaZC+X/nEubDonM+YeHTux31rrIjc1L80J/DsgKE3hJKqD5kcGl8FJ6zaBL5keln9RJjOSat7a0CmuAKsdCNoxQsiHm7zrrgRdcCIK4WGwm7AiBwhwErOoJiD6NxUkLeTgmrfw6SGwU3cfIPPT2tRz2HKMQFlykSbOAdJKC9ca/PE6Pfk5CDyYOLNqsccAFAlVVby8lY+iuSEC5/VPDd4eLXWUel2GLD/dbM7i7p7NjCYVbDW6anM1leNPvQYp3qwUqrMK4JFWTZP08fcesoktSHZv5a1FdKrulXHD4s='}, 'verbose': True, 'job_id': '4990027', 'tube': 'smithi', 'suite_branch': 'octopus', 'priority': 1000, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'octopus', 'suite': 'rgw', 'email': 'ceph-qa@ceph.io', 'archive_path': '/home/teuthworker/archive/teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi/4990027', 'description': 'rgw/verify/{centos_latest.yaml clusters/fixed-2.yaml frontend/beast.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/https.yaml rgw_pool_type/ec.yaml sharding$/{many.yaml} striping$/{stripe-greater-than-chunk.yaml} tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml} validater/lockdep.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'py2', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'name': 'teuthology-2020-04-27_05:05:02-rgw-octopus-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'overrides': {'s3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'rgw': {'frontend': 'beast', 'ec-data-pool': True, 'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}, 'storage classes': 'LUKEWARM, FROZEN', 'compression type': 'random'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99', 'branch': 'octopus'}, 'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'conf': {'mgr': {'debug ms': 1, 'debug mgr': 20}, 'global': {'osd_min_pg_log_entries': 10, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'rgw override bucket index max shards': 1999}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 20, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'lockdep': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1, 'lockdep': True}, 'client': {'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw max chunk size': 4194304, 'rgw lc debug interval': 10, 'rgw obj stripe size': 6291456}}, 'fs': 'xfs', 'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}, 'openssl_keys': {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}}, 'install': {'ceph': {'sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'}}, 'admin_socket': {'branch': 'octopus'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}}, 'os_type': 'centos', 'suite_sha1': 'a8c125c7d78f5cd973863993d258cd717ade4c99'} 2020-04-28T12:48:01.298 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:01.313 INFO:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:48:01.362 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:01.376 INFO:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-04-28T12:48:01.430 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:01.445 INFO:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:48:01.487 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:01.501 INFO:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2020-04-28T12:48:01.587 DEBUG:teuthology.orchestra.remote:smithi026:/scratch_devs is 72B 2020-04-28T12:48:01.636 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:48:01.636 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:01.651 INFO:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:48:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:48:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:01.707 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 61304 Links: 1 2020-04-28T12:48:01.708 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:01.708 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:01.708 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2020-04-28 12:47:55.778755590 +0000 2020-04-28T12:48:01.708 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2020-04-28 12:45:28.687585054 +0000 2020-04-28T12:48:01.708 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2020-04-28 12:45:28.687585054 +0000 2020-04-28T12:48:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2020-04-28T12:48:01.725 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2020-04-28T12:48:01.725 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2020-04-28T12:48:01.726 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000188951 s, 2.7 MB/s 2020-04-28T12:48:01.729 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:01.784 INFO:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:48:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:48:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:01.840 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 63185 Links: 1 2020-04-28T12:48:01.840 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:01.840 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:01.840 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2020-04-28 12:47:55.778755590 +0000 2020-04-28T12:48:01.841 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2020-04-28 12:45:29.067578975 +0000 2020-04-28T12:48:01.841 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2020-04-28 12:45:29.067578975 +0000 2020-04-28T12:48:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2020-04-28T12:48:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2020-04-28T12:48:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2020-04-28T12:48:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000208177 s, 2.5 MB/s 2020-04-28T12:48:01.860 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:01.914 INFO:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:48:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:48:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:01.969 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 61358 Links: 1 2020-04-28T12:48:01.970 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:01.970 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:01.970 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2020-04-28 12:47:55.778755590 +0000 2020-04-28T12:48:01.970 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2020-04-28 12:45:29.447572896 +0000 2020-04-28T12:48:01.970 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2020-04-28 12:45:29.447572896 +0000 2020-04-28T12:48:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2020-04-28T12:48:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2020-04-28T12:48:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2020-04-28T12:48:01.986 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.00020952 s, 2.4 MB/s 2020-04-28T12:48:01.989 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:02.050 INFO:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:48:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:48:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:02.105 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 63235 Links: 1 2020-04-28T12:48:02.105 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:02.105 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:02.106 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2020-04-28 12:47:55.778755590 +0000 2020-04-28T12:48:02.106 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2020-04-28 12:45:29.810567090 +0000 2020-04-28T12:48:02.106 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2020-04-28 12:45:29.810567090 +0000 2020-04-28T12:48:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2020-04-28T12:48:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2020-04-28T12:48:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2020-04-28T12:48:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000230104 s, 2.2 MB/s 2020-04-28T12:48:02.124 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:02.142 DEBUG:teuthology.orchestra.remote:smithi107:/scratch_devs is 72B 2020-04-28T12:48:02.191 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-04-28T12:48:02.192 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:02.206 INFO:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-04-28T12:48:02.260 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-04-28T12:48:02.260 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:02.260 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 61373 Links: 1 2020-04-28T12:48:02.260 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:02.261 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:02.261 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2020-04-28 12:47:49.234324004 +0000 2020-04-28T12:48:02.261 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2020-04-28 12:45:26.893816671 +0000 2020-04-28T12:48:02.261 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2020-04-28 12:45:26.893816671 +0000 2020-04-28T12:48:02.261 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2020-04-28T12:48:02.274 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2020-04-28T12:48:02.274 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2020-04-28T12:48:02.274 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00019172 s, 2.7 MB/s 2020-04-28T12:48:02.277 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:02.330 INFO:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-04-28T12:48:02.385 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-04-28T12:48:02.385 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:02.386 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 55135 Links: 1 2020-04-28T12:48:02.386 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:02.386 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:02.386 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2020-04-28 12:47:49.234324004 +0000 2020-04-28T12:48:02.386 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2020-04-28 12:45:27.228809956 +0000 2020-04-28T12:48:02.386 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2020-04-28 12:45:27.228809956 +0000 2020-04-28T12:48:02.387 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2020-04-28T12:48:02.399 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2020-04-28T12:48:02.399 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2020-04-28T12:48:02.399 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000190001 s, 2.7 MB/s 2020-04-28T12:48:02.401 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:02.456 INFO:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-04-28T12:48:02.510 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-04-28T12:48:02.511 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:02.511 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 65563 Links: 1 2020-04-28T12:48:02.511 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:02.512 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:02.512 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2020-04-28 12:47:49.234324004 +0000 2020-04-28T12:48:02.512 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2020-04-28 12:45:27.596802579 +0000 2020-04-28T12:48:02.512 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2020-04-28 12:45:27.596802579 +0000 2020-04-28T12:48:02.512 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2020-04-28T12:48:02.524 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2020-04-28T12:48:02.524 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2020-04-28T12:48:02.524 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000232515 s, 2.2 MB/s 2020-04-28T12:48:02.527 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:02.580 INFO:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-04-28T12:48:02.635 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-04-28T12:48:02.635 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-04-28T12:48:02.635 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 64064 Links: 1 2020-04-28T12:48:02.636 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-04-28T12:48:02.636 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2020-04-28T12:48:02.636 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2020-04-28 12:47:49.234324004 +0000 2020-04-28T12:48:02.636 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2020-04-28 12:45:27.954795402 +0000 2020-04-28T12:48:02.636 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2020-04-28 12:45:27.954795402 +0000 2020-04-28T12:48:02.636 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2020-04-28T12:48:02.651 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2020-04-28T12:48:02.651 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2020-04-28T12:48:02.651 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.0002685 s, 1.9 MB/s 2020-04-28T12:48:02.652 INFO:tasks.ceph:osd dev map: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:02.652 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:48:02.652 INFO:tasks.ceph:Generating config... 2020-04-28T12:48:02.653 INFO:tasks.ceph:[mgr] debug ms = 1 2020-04-28T12:48:02.653 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-04-28T12:48:02.653 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2020-04-28T12:48:02.654 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2020-04-28T12:48:02.654 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2020-04-28T12:48:02.654 INFO:tasks.ceph:[global] mon client directed command retry = 5 2020-04-28T12:48:02.654 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1999 2020-04-28T12:48:02.654 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-04-28T12:48:02.655 INFO:tasks.ceph:[osd] debug ms = 20 2020-04-28T12:48:02.655 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-04-28T12:48:02.655 INFO:tasks.ceph:[osd] debug osd = 25 2020-04-28T12:48:02.655 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-04-28T12:48:02.655 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-04-28T12:48:02.655 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] debug journal = 20 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] bdev async discard = True 2020-04-28T12:48:02.656 INFO:tasks.ceph:[osd] lockdep = True 2020-04-28T12:48:02.657 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-04-28T12:48:02.657 INFO:tasks.ceph:[osd] debug filestore = 20 2020-04-28T12:48:02.657 INFO:tasks.ceph:[osd] bdev enable discard = True 2020-04-28T12:48:02.657 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-04-28T12:48:02.657 INFO:tasks.ceph:[mon] debug mon = 20 2020-04-28T12:48:02.657 INFO:tasks.ceph:[mon] debug paxos = 20 2020-04-28T12:48:02.657 INFO:tasks.ceph:[mon] debug ms = 1 2020-04-28T12:48:02.658 INFO:tasks.ceph:[mon] lockdep = True 2020-04-28T12:48:02.658 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2020-04-28T12:48:02.658 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:48:02.658 INFO:tasks.ceph:[client] debug rgw = 20 2020-04-28T12:48:02.658 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2020-04-28T12:48:02.658 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2020-04-28T12:48:02.658 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2020-04-28T12:48:02.658 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2020-04-28T12:48:02.659 INFO:tasks.ceph:Setting up mon.a... 2020-04-28T12:48:02.659 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:02.680 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-04-28T12:48:02.779 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2020-04-28T12:48:02.781 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:02.796 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-04-28T12:48:02.884 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:02.898 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:48:02.970 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.c', '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]'), ('mon.b', '172.21.15.107')] 2020-04-28T12:48:02.970 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:03.024 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.26 --addv c '[v2:172.21.15.26:3301,v1:172.21.15.26:6790]' --add b 172.21.15.107 --print /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:03.103 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:03.103 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid 00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de 2020-04-28T12:48:03.103 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2020-04-28T12:48:03.103 INFO:teuthology.orchestra.run.smithi026.stdout:fsid 00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de 2020-04-28T12:48:03.104 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2020-04-28T12:48:03.099715+0000 2020-04-28T12:48:03.104 INFO:teuthology.orchestra.run.smithi026.stdout:created 2020-04-28T12:48:03.099715+0000 2020-04-28T12:48:03.104 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 0 (unknown) 2020-04-28T12:48:03.104 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2020-04-28T12:48:03.104 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2020-04-28T12:48:03.104 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] mon.c 2020-04-28T12:48:03.105 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-04-28T12:48:03.106 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de... 2020-04-28T12:48:03.107 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:03.159 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:48:03.201 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:03.217 INFO:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-04-28T12:48:03.263 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2020-04-28T12:48:03.263 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2020-04-28T12:48:03.263 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:48:03.263 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2020-04-28T12:48:03.263 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.264 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2020-04-28T12:48:03.264 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.264 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2020-04-28T12:48:03.264 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.264 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2020-04-28T12:48:03.264 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2020-04-28T12:48:03.265 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.265 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2020-04-28T12:48:03.265 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2020-04-28T12:48:03.265 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.265 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:48:03.265 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2020-04-28T12:48:03.265 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.266 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:48:03.266 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:48:03.266 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.266 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2020-04-28T12:48:03.266 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.266 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2020-04-28T12:48:03.267 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2020-04-28T12:48:03.267 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:48:03.267 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:48:03.267 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2020-04-28T12:48:03.267 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:48:03.267 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2020-04-28T12:48:03.267 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:48:03.268 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:48:03.268 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.268 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:48:03.268 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.268 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2020-04-28T12:48:03.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.269 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2020-04-28T12:48:03.269 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.269 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2020-04-28T12:48:03.269 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2020-04-28T12:48:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790],172.21.15.107" 2020-04-28T12:48:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:48:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject socket failures = 5000 2020-04-28T12:48:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:48:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: mon client directed command retry = 5 2020-04-28T12:48:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:48:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de 2020-04-28T12:48:03.271 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.271 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2020-04-28T12:48:03.271 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2020-04-28T12:48:03.271 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.271 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2020-04-28T12:48:03.271 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2020-04-28T12:48:03.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.272 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2020-04-28T12:48:03.272 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2020-04-28T12:48:03.272 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.272 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2020-04-28T12:48:03.272 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2020-04-28T12:48:03.272 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2020-04-28T12:48:03.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.273 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2020-04-28T12:48:03.273 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2020-04-28T12:48:03.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.273 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:48:03.273 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.273 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2020-04-28T12:48:03.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.274 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2020-04-28T12:48:03.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.274 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:48:03.274 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2020-04-28T12:48:03.274 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.275 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2020-04-28T12:48:03.275 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2020-04-28T12:48:03.275 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2020-04-28T12:48:03.275 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 20 2020-04-28T12:48:03.275 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2020-04-28T12:48:03.275 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 25 2020-04-28T12:48:03.275 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 20 2020-04-28T12:48:03.276 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 20 2020-04-28T12:48:03.276 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2020-04-28T12:48:03.276 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 10 2020-04-28T12:48:03.276 INFO:teuthology.orchestra.run.smithi026.stdout: osd shutdown pgref assert = True 2020-04-28T12:48:03.276 INFO:teuthology.orchestra.run.smithi026.stdout: debug journal = 20 2020-04-28T12:48:03.276 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2020-04-28T12:48:03.277 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2020-04-28T12:48:03.277 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2020-04-28T12:48:03.277 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2020-04-28T12:48:03.277 INFO:teuthology.orchestra.run.smithi026.stdout: lockdep = True 2020-04-28T12:48:03.277 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2020-04-28T12:48:03.277 INFO:teuthology.orchestra.run.smithi026.stdout: debug filestore = 20 2020-04-28T12:48:03.278 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2020-04-28T12:48:03.278 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2020-04-28T12:48:03.278 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.278 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2020-04-28T12:48:03.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2020-04-28T12:48:03.278 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2020-04-28T12:48:03.279 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2020-04-28T12:48:03.279 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2020-04-28T12:48:03.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:48:03.279 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:48:03.280 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2020-04-28T12:48:03.280 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.280 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2020-04-28T12:48:03.280 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2020-04-28T12:48:03.280 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2020-04-28T12:48:03.280 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2020-04-28T12:48:03.280 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2020-04-28T12:48:03.281 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2020-04-28T12:48:03.281 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2020-04-28T12:48:03.281 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:48:03.281 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2020-04-28T12:48:03.281 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2020-04-28T12:48:03.281 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:48:03.282 INFO:teuthology.orchestra.run.smithi026.stdout: lockdep = True 2020-04-28T12:48:03.282 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:48:03.282 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2020-04-28T12:48:03.282 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2020-04-28T12:48:03.282 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2020-04-28T12:48:03.282 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2020-04-28T12:48:03.282 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:48:03.283 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:48:03.283 INFO:teuthology.orchestra.run.smithi026.stdout: rgw crypt require ssl = False 2020-04-28T12:48:03.283 INFO:teuthology.orchestra.run.smithi026.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:48:03.283 INFO:teuthology.orchestra.run.smithi026.stdout: debug rgw = 20 2020-04-28T12:48:03.283 INFO:teuthology.orchestra.run.smithi026.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:48:03.283 INFO:teuthology.orchestra.run.smithi026.stdout: rgw max chunk size = 4194304 2020-04-28T12:48:03.284 INFO:teuthology.orchestra.run.smithi026.stdout: rgw lc debug interval = 10 2020-04-28T12:48:03.284 INFO:teuthology.orchestra.run.smithi026.stdout: rgw obj stripe size = 6291456 2020-04-28T12:48:03.284 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2020-04-28T12:48:03.284 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2020-04-28T12:48:03.284 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2020-04-28T12:48:03.313 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2020-04-28T12:48:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2020-04-28T12:48:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-04-28T12:48:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2020-04-28T12:48:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2020-04-28T12:48:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2020-04-28T12:48:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2020-04-28T12:48:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2020-04-28T12:48:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2020-04-28T12:48:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2020-04-28T12:48:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2020-04-28T12:48:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2020-04-28T12:48:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2020-04-28T12:48:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2020-04-28T12:48:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2020-04-28T12:48:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2020-04-28T12:48:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2020-04-28T12:48:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2020-04-28T12:48:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2020-04-28T12:48:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2020-04-28T12:48:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2020-04-28T12:48:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2020-04-28T12:48:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-04-28T12:48:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2020-04-28T12:48:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-04-28T12:48:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2020-04-28T12:48:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2020-04-28T12:48:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2020-04-28T12:48:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2020-04-28T12:48:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.26,[v2:172.21.15.26:3301,v1:172.21.15.26:6790],172.21.15.107" 2020-04-28T12:48:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: osd_min_pg_log_entries = 10 2020-04-28T12:48:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: ms inject socket failures = 5000 2020-04-28T12:48:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: osd_max_pg_log_entries = 10 2020-04-28T12:48:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: mon client directed command retry = 5 2020-04-28T12:48:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: rgw override bucket index max shards = 1999 2020-04-28T12:48:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de 2020-04-28T12:48:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.323 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2020-04-28T12:48:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2020-04-28T12:48:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2020-04-28T12:48:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2020-04-28T12:48:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2020-04-28T12:48:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2020-04-28T12:48:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2020-04-28T12:48:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2020-04-28T12:48:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2020-04-28T12:48:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2020-04-28T12:48:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2020-04-28T12:48:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2020-04-28T12:48:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2020-04-28T12:48:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2020-04-28T12:48:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2020-04-28T12:48:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2020-04-28T12:48:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2020-04-28T12:48:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2020-04-28T12:48:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2020-04-28T12:48:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 20 2020-04-28T12:48:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2020-04-28T12:48:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 25 2020-04-28T12:48:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 20 2020-04-28T12:48:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 20 2020-04-28T12:48:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2020-04-28T12:48:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 10 2020-04-28T12:48:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: osd shutdown pgref assert = True 2020-04-28T12:48:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: debug journal = 20 2020-04-28T12:48:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2020-04-28T12:48:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2020-04-28T12:48:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2020-04-28T12:48:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2020-04-28T12:48:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: lockdep = True 2020-04-28T12:48:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2020-04-28T12:48:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: debug filestore = 20 2020-04-28T12:48:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2020-04-28T12:48:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2020-04-28T12:48:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.330 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2020-04-28T12:48:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2020-04-28T12:48:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2020-04-28T12:48:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2020-04-28T12:48:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2020-04-28T12:48:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:48:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:48:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2020-04-28T12:48:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.332 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2020-04-28T12:48:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2020-04-28T12:48:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2020-04-28T12:48:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2020-04-28T12:48:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2020-04-28T12:48:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2020-04-28T12:48:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2020-04-28T12:48:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2020-04-28T12:48:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2020-04-28T12:48:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2020-04-28T12:48:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2020-04-28T12:48:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: lockdep = True 2020-04-28T12:48:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: 2020-04-28T12:48:03.334 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2020-04-28T12:48:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2020-04-28T12:48:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2020-04-28T12:48:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2020-04-28T12:48:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-04-28T12:48:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-04-28T12:48:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: rgw crypt require ssl = False 2020-04-28T12:48:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2020-04-28T12:48:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: debug rgw = 20 2020-04-28T12:48:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: rgw crypt s3 kms backend = testing 2020-04-28T12:48:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: rgw max chunk size = 4194304 2020-04-28T12:48:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: rgw lc debug interval = 10 2020-04-28T12:48:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: rgw obj stripe size = 6291456 2020-04-28T12:48:03.336 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2020-04-28T12:48:03.336 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2020-04-28T12:48:03.336 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2020-04-28T12:48:03.337 INFO:tasks.ceph:Creating admin key on mon.a... 2020-04-28T12:48:03.338 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:03.352 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-04-28T12:48:03.448 INFO:tasks.ceph:Copying monmap to all nodes... 2020-04-28T12:48:03.470 DEBUG:teuthology.orchestra.remote:smithi026:/etc/ceph/ceph.keyring is 206B 2020-04-28T12:48:03.587 DEBUG:teuthology.orchestra.remote:smithi026:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-04-28T12:48:03.634 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2020-04-28T12:48:03.635 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:03.649 INFO:teuthology.orchestra.run.smithi026:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:48:03.750 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:03.804 INFO:teuthology.orchestra.run.smithi026:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:03.889 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:48:03.889 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:03.905 INFO:teuthology.orchestra.run.smithi107:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-04-28T12:48:04.006 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:04.061 INFO:teuthology.orchestra.run.smithi107:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:04.146 INFO:tasks.ceph:Setting up mon nodes... 2020-04-28T12:48:04.146 INFO:tasks.ceph:Setting up mgr nodes... 2020-04-28T12:48:04.146 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:04.160 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:48:04.274 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-04-28T12:48:04.276 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:04.291 INFO:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:48:04.391 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-04-28T12:48:04.393 INFO:tasks.ceph:Setting up mds nodes... 2020-04-28T12:48:04.394 INFO:tasks.ceph_client:Setting up client nodes... 2020-04-28T12:48:04.394 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:04.408 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-04-28T12:48:04.491 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-04-28T12:48:04.511 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:04.525 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-04-28T12:48:04.605 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-04-28T12:48:04.621 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-04-28T12:48:04.622 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-04-28T12:48:04.622 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:04.636 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-04-28T12:48:04.708 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:04.708 INFO:tasks.ceph:role: osd.0 2020-04-28T12:48:04.708 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2020-04-28T12:48:04.709 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:04.762 INFO:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:48:05.286 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:05.288 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:05.288 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:05.288 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2020-04-28T12:48:05.288 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:05.288 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:05.288 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:05.288 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:05.289 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:05.289 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:05.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2020-04-28T12:48:05.290 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:05.306 INFO:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-04-28T12:48:05.465 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:05.479 INFO:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-04-28T12:48:05.565 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:05.619 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-04-28T12:48:05.697 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:05.697 INFO:tasks.ceph:role: osd.1 2020-04-28T12:48:05.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2020-04-28T12:48:05.697 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:05.751 INFO:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:48:06.263 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:06.263 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:06.263 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:06.263 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2020-04-28T12:48:06.264 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:06.264 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:06.264 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:06.264 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:06.264 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:06.264 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:06.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2020-04-28T12:48:06.265 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:06.284 INFO:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1 2020-04-28T12:48:06.395 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:06.409 INFO:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-04-28T12:48:06.484 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:06.538 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-04-28T12:48:06.610 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:06.610 INFO:tasks.ceph:role: osd.2 2020-04-28T12:48:06.610 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2020-04-28T12:48:06.611 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:06.664 INFO:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:48:07.200 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:07.201 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:07.201 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:07.201 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2020-04-28T12:48:07.201 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:07.201 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:07.202 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:07.202 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:07.202 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:07.202 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:07.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2020-04-28T12:48:07.204 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:07.219 INFO:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-04-28T12:48:07.382 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:07.397 INFO:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-04-28T12:48:07.473 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:07.528 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-04-28T12:48:07.600 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_3', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:07.600 INFO:tasks.ceph:role: osd.3 2020-04-28T12:48:07.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2020-04-28T12:48:07.600 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:07.655 INFO:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:48:08.159 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:08.159 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:08.159 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:08.160 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2020-04-28T12:48:08.160 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:08.160 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:08.160 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:08.160 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:08.160 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:08.160 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:08.161 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2020-04-28T12:48:08.162 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:08.177 INFO:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2020-04-28T12:48:08.283 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:08.297 INFO:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-04-28T12:48:08.373 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:08.427 INFO:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:08.515 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:08.510+0000 7fd5d6343ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-04-28T12:48:08.516 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:08.511+0000 7fd5d6343ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-04-28T12:48:08.516 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:08.511+0000 7fd5d6343ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-28T12:48:08.516 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:08.511+0000 7fd5d6343ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-28T12:48:08.516 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:08.511+0000 7fd5d6343ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-04-28T12:48:08.517 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:08.512+0000 7fd5d6343ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-04-28T12:48:10.854 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:10.872 INFO:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-04-28T12:48:10.954 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:11.010 INFO:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:11.103 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:11.098+0000 7f00b006fec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-04-28T12:48:11.103 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:11.098+0000 7f00b006fec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-04-28T12:48:11.103 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:11.098+0000 7f00b006fec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-28T12:48:11.104 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:11.098+0000 7f00b006fec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-28T12:48:11.104 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:11.098+0000 7f00b006fec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-04-28T12:48:11.104 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:11.099+0000 7f00b006fec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-04-28T12:48:13.442 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:13.459 INFO:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-04-28T12:48:13.534 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:13.593 INFO:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:13.680+0000 7ff80144eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-04-28T12:48:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:13.680+0000 7ff80144eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-04-28T12:48:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:13.680+0000 7ff80144eec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-28T12:48:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:13.680+0000 7ff80144eec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-28T12:48:13.689 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:13.680+0000 7ff80144eec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-04-28T12:48:13.690 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:13.680+0000 7ff80144eec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-04-28T12:48:16.019 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:16.039 INFO:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-04-28T12:48:16.115 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:16.171 INFO:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:16.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:16.259+0000 7f5172e0cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-04-28T12:48:16.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:16.259+0000 7f5172e0cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-04-28T12:48:16.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:16.259+0000 7f5172e0cec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-28T12:48:16.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:16.259+0000 7f5172e0cec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-28T12:48:16.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:16.259+0000 7f5172e0cec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-04-28T12:48:16.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:48:16.260+0000 7f5172e0cec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-04-28T12:48:18.598 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:18.615 INFO:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-04-28T12:48:18.693 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:18.710 INFO:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-04-28T12:48:18.782 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:18.782 INFO:tasks.ceph:role: osd.4 2020-04-28T12:48:18.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:48:18.782 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:18.837 INFO:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-04-28T12:48:19.377 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2020-04-28T12:48:19.378 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:19.378 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:19.378 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:19.378 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:19.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2020-04-28T12:48:19.379 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:19.395 INFO:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-04-28T12:48:19.550 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:19.564 INFO:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-04-28T12:48:19.637 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:19.691 INFO:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-04-28T12:48:19.759 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:19.759 INFO:tasks.ceph:role: osd.5 2020-04-28T12:48:19.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:48:19.760 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:19.813 INFO:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-04-28T12:48:20.331 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:20.331 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:20.331 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:20.331 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2020-04-28T12:48:20.331 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:20.331 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:20.332 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:20.332 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:20.332 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:20.332 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:20.333 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2020-04-28T12:48:20.333 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:20.347 INFO:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2020-04-28T12:48:20.464 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:20.477 INFO:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-04-28T12:48:20.551 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:20.606 INFO:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-04-28T12:48:20.672 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:20.673 INFO:tasks.ceph:role: osd.6 2020-04-28T12:48:20.673 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:48:20.673 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:20.726 INFO:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-04-28T12:48:21.246 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2020-04-28T12:48:21.246 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:21.247 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:21.247 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:21.247 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:21.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2020-04-28T12:48:21.248 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:21.264 INFO:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-04-28T12:48:21.410 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:21.423 INFO:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-04-28T12:48:21.492 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:21.546 INFO:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-04-28T12:48:21.613 INFO:tasks.ceph:roles_to_devs: {'osd.5': '/dev/vg_nvme/lv_3', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-04-28T12:48:21.614 INFO:tasks.ceph:role: osd.7 2020-04-28T12:48:21.614 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:48:21.614 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:21.667 INFO:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-04-28T12:48:22.166 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-04-28T12:48:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2020-04-28T12:48:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-04-28T12:48:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2020-04-28T12:48:22.167 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-04-28T12:48:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2020-04-28T12:48:22.167 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-04-28T12:48:22.167 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-04-28T12:48:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-04-28T12:48:22.168 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-04-28T12:48:22.168 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2020-04-28T12:48:22.169 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:22.182 INFO:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7 2020-04-28T12:48:22.289 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:22.302 INFO:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-04-28T12:48:22.372 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:22.425 INFO:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:22.508 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:22.503+0000 7f5af6363ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-04-28T12:48:22.508 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:22.503+0000 7f5af6363ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-04-28T12:48:22.509 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:22.503+0000 7f5af6363ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-28T12:48:22.509 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:22.503+0000 7f5af6363ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-28T12:48:22.509 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:22.503+0000 7f5af6363ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-04-28T12:48:22.515 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:22.510+0000 7f5af6363ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-04-28T12:48:24.851 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:24.907 INFO:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-04-28T12:48:24.980 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:25.035 INFO:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:25.120 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:25.115+0000 7f41f4eddec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-04-28T12:48:25.121 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:25.115+0000 7f41f4eddec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-04-28T12:48:25.121 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:25.115+0000 7f41f4eddec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-28T12:48:25.121 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:25.115+0000 7f41f4eddec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-28T12:48:25.121 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:25.115+0000 7f41f4eddec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-04-28T12:48:25.122 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:25.116+0000 7f41f4eddec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-04-28T12:48:27.454 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:27.470 INFO:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-04-28T12:48:27.540 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:27.594 INFO:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:27.679 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:27.674+0000 7ff87e2bbec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-04-28T12:48:27.680 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:27.674+0000 7ff87e2bbec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-04-28T12:48:27.680 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:27.674+0000 7ff87e2bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-28T12:48:27.680 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:27.674+0000 7ff87e2bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-28T12:48:27.680 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:27.674+0000 7ff87e2bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-04-28T12:48:27.681 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:27.675+0000 7ff87e2bbec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-04-28T12:48:30.021 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:30.037 INFO:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-04-28T12:48:30.108 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:30.164 INFO:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:30.250 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:30.245+0000 7f36cc979ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-04-28T12:48:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:30.245+0000 7f36cc979ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-04-28T12:48:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:30.245+0000 7f36cc979ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-28T12:48:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:30.245+0000 7f36cc979ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-28T12:48:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:30.245+0000 7f36cc979ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-04-28T12:48:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2020-04-28T12:48:30.246+0000 7f36cc979ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-04-28T12:48:32.585 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:32.601 INFO:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-04-28T12:48:32.672 INFO:tasks.ceph:Reading keys from all nodes... 2020-04-28T12:48:32.673 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:32.690 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:32.748 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.5OXbSswIYh 2020-04-28T12:48:32.748 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:32.807 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.5OXbSswIYh 2020-04-28T12:48:32.890 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:32.947 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.5OXbSswIYh 2020-04-28T12:48:33.080 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.5OXbSswIYh is 56B 2020-04-28T12:48:33.129 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:33.143 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.5OXbSswIYh 2020-04-28T12:48:33.198 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:33.252 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:33.309 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.sXRvg9iEZu 2020-04-28T12:48:33.309 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:33.364 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.sXRvg9iEZu 2020-04-28T12:48:33.436 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:33.491 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.sXRvg9iEZu 2020-04-28T12:48:33.620 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.sXRvg9iEZu is 56B 2020-04-28T12:48:33.680 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:33.694 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.sXRvg9iEZu 2020-04-28T12:48:33.747 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:33.804 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:33.859 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.7jBxKCZpzq 2020-04-28T12:48:33.859 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:33.913 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.7jBxKCZpzq 2020-04-28T12:48:33.988 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.048 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.7jBxKCZpzq 2020-04-28T12:48:34.177 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.7jBxKCZpzq is 56B 2020-04-28T12:48:34.225 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.239 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.7jBxKCZpzq 2020-04-28T12:48:34.293 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.350 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:34.404 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.c5BhVJtGuQ 2020-04-28T12:48:34.404 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.458 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.c5BhVJtGuQ 2020-04-28T12:48:34.529 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.583 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.c5BhVJtGuQ 2020-04-28T12:48:34.710 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.c5BhVJtGuQ is 56B 2020-04-28T12:48:34.758 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.771 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.c5BhVJtGuQ 2020-04-28T12:48:34.826 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.879 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:34.935 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.6DeyH6jjdS 2020-04-28T12:48:34.935 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:34.989 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.6DeyH6jjdS 2020-04-28T12:48:35.060 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:35.114 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.6DeyH6jjdS 2020-04-28T12:48:35.241 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.6DeyH6jjdS is 56B 2020-04-28T12:48:35.290 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:35.305 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.6DeyH6jjdS 2020-04-28T12:48:35.358 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:35.375 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:35.431 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.qXhsazSu9E 2020-04-28T12:48:35.431 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:35.487 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.qXhsazSu9E 2020-04-28T12:48:35.559 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:35.614 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.qXhsazSu9E 2020-04-28T12:48:35.742 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.qXhsazSu9E is 56B 2020-04-28T12:48:35.790 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:35.807 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.qXhsazSu9E 2020-04-28T12:48:35.858 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:35.912 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:35.967 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.Ur04P8WK3P 2020-04-28T12:48:35.967 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.021 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Ur04P8WK3P 2020-04-28T12:48:36.089 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.143 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.Ur04P8WK3P 2020-04-28T12:48:36.268 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.Ur04P8WK3P is 56B 2020-04-28T12:48:36.316 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.330 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.Ur04P8WK3P 2020-04-28T12:48:36.383 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.436 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:36.490 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.9BjA4kqrgE 2020-04-28T12:48:36.490 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.543 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.9BjA4kqrgE 2020-04-28T12:48:36.610 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.663 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.9BjA4kqrgE 2020-04-28T12:48:36.786 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.9BjA4kqrgE is 56B 2020-04-28T12:48:36.833 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.846 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.9BjA4kqrgE 2020-04-28T12:48:36.902 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:36.956 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:37.009 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.PPw67r68Zc 2020-04-28T12:48:37.009 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:37.062 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.PPw67r68Zc 2020-04-28T12:48:37.129 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:37.182 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.PPw67r68Zc 2020-04-28T12:48:37.307 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.PPw67r68Zc is 56B 2020-04-28T12:48:37.356 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:37.369 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.PPw67r68Zc 2020-04-28T12:48:37.428 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:37.481 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:37.535 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.pfHvVEf1SQ 2020-04-28T12:48:37.535 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:37.588 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.pfHvVEf1SQ 2020-04-28T12:48:37.655 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:37.708 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.pfHvVEf1SQ 2020-04-28T12:48:37.831 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.pfHvVEf1SQ is 56B 2020-04-28T12:48:37.886 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:37.900 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.pfHvVEf1SQ 2020-04-28T12:48:37.984 DEBUG:teuthology.orchestra.remote:smithi026:/etc/ceph/ceph.client.0.keyring is 59B 2020-04-28T12:48:38.048 DEBUG:teuthology.orchestra.remote:smithi107:/etc/ceph/ceph.client.1.keyring is 59B 2020-04-28T12:48:38.096 INFO:tasks.ceph:Adding keys to all mons... 2020-04-28T12:48:38.096 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:38.113 INFO:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:48:38.155 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:38.168 INFO:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2020-04-28T12:48:38.210 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2020-04-28T12:48:38.210 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAEJqhembApEBAASUIFc2oFMXNR254/JZIFow== 2020-04-28T12:48:38.210 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2020-04-28T12:48:38.210 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAIJqhe0EmCHhAA35TlqcsrGtaM86V4wEVhzQ== 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQALJqheSxHvBRAA1FNMGGdV21VpFQoJLz/jKw== 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQANJqheZYqXKBAAQ8U5aK+ykNg58fz0GgEn/A== 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAQJqhelzqEDxAA/s4jhhmEkz+wE3JkGzE1UA== 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2020-04-28T12:48:38.211 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAEJqhe1A8mFxAA7SMuIQU+OhEGQtiBVRZfjw== 2020-04-28T12:48:38.212 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2020-04-28T12:48:38.212 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAWJqhez/AWHhAAEmotgAaSafl3cwmeBU9+EQ== 2020-04-28T12:48:38.212 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2020-04-28T12:48:38.212 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAZJqheqE74BhAAk+1PV+wM04yFXgaon2Wzmw== 2020-04-28T12:48:38.212 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2020-04-28T12:48:38.212 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAbJqheLExNKBAAtz/+S7GgnWMwsdfi91ZmjQ== 2020-04-28T12:48:38.212 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2020-04-28T12:48:38.213 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAeJqhejcC2DhAAGPUE2jWL0yE+743+oEGzZA== 2020-04-28T12:48:38.213 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2020-04-28T12:48:38.213 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAEJqhevoQcHRAA8R2JE8OJ87KPLbLB7vWVqg== 2020-04-28T12:48:38.213 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2020-04-28T12:48:38.213 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQAEJqheAj7kIxAAmw+HI7Z1EfWOWVmoMcaSaA== 2020-04-28T12:48:38.236 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2020-04-28T12:48:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAEJqhembApEBAASUIFc2oFMXNR254/JZIFow== 2020-04-28T12:48:38.237 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2020-04-28T12:48:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAIJqhe0EmCHhAA35TlqcsrGtaM86V4wEVhzQ== 2020-04-28T12:48:38.237 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2020-04-28T12:48:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQALJqheSxHvBRAA1FNMGGdV21VpFQoJLz/jKw== 2020-04-28T12:48:38.237 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2020-04-28T12:48:38.237 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQANJqheZYqXKBAAQ8U5aK+ykNg58fz0GgEn/A== 2020-04-28T12:48:38.238 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2020-04-28T12:48:38.238 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAQJqhelzqEDxAA/s4jhhmEkz+wE3JkGzE1UA== 2020-04-28T12:48:38.239 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2020-04-28T12:48:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAEJqhe1A8mFxAA7SMuIQU+OhEGQtiBVRZfjw== 2020-04-28T12:48:38.239 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2020-04-28T12:48:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAWJqhez/AWHhAAEmotgAaSafl3cwmeBU9+EQ== 2020-04-28T12:48:38.239 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2020-04-28T12:48:38.239 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAZJqheqE74BhAAk+1PV+wM04yFXgaon2Wzmw== 2020-04-28T12:48:38.239 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2020-04-28T12:48:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAbJqheLExNKBAAtz/+S7GgnWMwsdfi91ZmjQ== 2020-04-28T12:48:38.240 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2020-04-28T12:48:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAeJqhejcC2DhAAGPUE2jWL0yE+743+oEGzZA== 2020-04-28T12:48:38.240 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2020-04-28T12:48:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAEJqhevoQcHRAA8R2JE8OJ87KPLbLB7vWVqg== 2020-04-28T12:48:38.240 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2020-04-28T12:48:38.240 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAEJqheAj7kIxAAmw+HI7Z1EfWOWVmoMcaSaA== 2020-04-28T12:48:38.241 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:38.271 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:48:38.314 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:38.327 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:48:38.414 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:38.430 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:38.473 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:38.487 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:38.581 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:38.596 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:38.639 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:38.652 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:38.739 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:38.755 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:38.797 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:38.811 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:38.898 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:38.912 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:38.955 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:38.968 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.055 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:39.069 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:48:39.112 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:39.125 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-04-28T12:48:39.214 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:39.228 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.271 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:39.285 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.372 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:39.386 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.428 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:39.442 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.533 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:39.548 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.591 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:39.605 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.693 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:39.706 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.748 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:39.762 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-04-28T12:48:39.851 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:39.865 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:48:39.908 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:39.923 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:48:40.013 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:40.031 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:48:40.073 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:40.087 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-04-28T12:48:40.178 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-04-28T12:48:40.178 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:40.192 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-04-28T12:48:40.263 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:40.320 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:48:40.419 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:40.433 INFO:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-04-28T12:48:40.505 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:40.560 INFO:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-04-28T12:48:40.631 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:40.685 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:48:40.782 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:40.795 INFO:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-04-28T12:48:40.866 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:40.882 INFO:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-04-28T12:48:40.953 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:41.009 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-04-28T12:48:41.115 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:41.136 INFO:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-04-28T12:48:41.204 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:41.219 INFO:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:41.264 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:41.277 INFO:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-04-28T12:48:41.332 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-04-28T12:48:41.333 INFO:tasks.ceph.mon.a:Restarting daemon 2020-04-28T12:48:41.333 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:41.348 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-04-28T12:48:41.390 INFO:tasks.ceph.mon.a:Started 2020-04-28T12:48:41.390 INFO:tasks.ceph.mon.c:Restarting daemon 2020-04-28T12:48:41.390 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:41.406 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-04-28T12:48:41.448 INFO:tasks.ceph.mon.c:Started 2020-04-28T12:48:41.449 INFO:tasks.ceph.mon.b:Restarting daemon 2020-04-28T12:48:41.449 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:41.465 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-04-28T12:48:41.507 INFO:tasks.ceph.mon.b:Started 2020-04-28T12:48:41.507 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-04-28T12:48:41.508 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-04-28T12:48:41.508 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:41.523 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-04-28T12:48:41.564 INFO:tasks.ceph.mgr.y:Started 2020-04-28T12:48:41.565 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-04-28T12:48:41.565 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:41.579 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-04-28T12:48:41.629 INFO:tasks.ceph.mgr.x:Started 2020-04-28T12:48:41.629 INFO:tasks.ceph:Setting crush tunables to default 2020-04-28T12:48:41.629 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:41.643 INFO:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2020-04-28T12:48:46.838 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2020-04-28T12:48:46.848 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-04-28T12:48:46.848 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:46.864 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:46.919 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.XF9cAC1gAE 2020-04-28T12:48:46.919 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:46.973 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.XF9cAC1gAE 2020-04-28T12:48:47.044 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:47.098 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.XF9cAC1gAE 2020-04-28T12:48:47.226 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.XF9cAC1gAE is 37B 2020-04-28T12:48:47.274 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:47.287 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.XF9cAC1gAE 2020-04-28T12:48:47.343 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:47.402 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:47.456 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.gR5Y0HldHM 2020-04-28T12:48:47.457 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:47.510 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.gR5Y0HldHM 2020-04-28T12:48:47.582 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:47.637 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.gR5Y0HldHM 2020-04-28T12:48:47.766 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.gR5Y0HldHM is 37B 2020-04-28T12:48:47.813 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:47.841 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.gR5Y0HldHM 2020-04-28T12:48:47.896 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:47.949 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:48.003 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.yETVpEDKgi 2020-04-28T12:48:48.004 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:48.057 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.yETVpEDKgi 2020-04-28T12:48:48.133 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:48.187 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.yETVpEDKgi 2020-04-28T12:48:48.316 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.yETVpEDKgi is 37B 2020-04-28T12:48:48.365 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:48.379 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.yETVpEDKgi 2020-04-28T12:48:48.433 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:48.487 INFO:teuthology.orchestra.run.smithi026:> mktemp 2020-04-28T12:48:48.540 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.LHB4NruWGv 2020-04-28T12:48:48.541 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:48.594 INFO:teuthology.orchestra.run.smithi026:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.LHB4NruWGv 2020-04-28T12:48:48.667 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:48.721 INFO:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.LHB4NruWGv 2020-04-28T12:48:48.849 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.LHB4NruWGv is 37B 2020-04-28T12:48:48.895 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:48.909 INFO:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.LHB4NruWGv 2020-04-28T12:48:48.963 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:48.978 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:49.032 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.zdsClQPwLz 2020-04-28T12:48:49.032 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:49.086 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.zdsClQPwLz 2020-04-28T12:48:49.154 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:49.207 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.zdsClQPwLz 2020-04-28T12:48:49.332 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.zdsClQPwLz is 37B 2020-04-28T12:48:49.380 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:49.393 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.zdsClQPwLz 2020-04-28T12:48:49.447 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:49.500 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:49.554 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.8li2nvkxiz 2020-04-28T12:48:49.554 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:49.607 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.8li2nvkxiz 2020-04-28T12:48:49.674 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:49.735 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.8li2nvkxiz 2020-04-28T12:48:49.858 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.8li2nvkxiz is 37B 2020-04-28T12:48:49.906 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:49.919 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.8li2nvkxiz 2020-04-28T12:48:49.972 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.026 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:50.080 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.KWe9OiDE4G 2020-04-28T12:48:50.080 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.133 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.KWe9OiDE4G 2020-04-28T12:48:50.200 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.253 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.KWe9OiDE4G 2020-04-28T12:48:50.376 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.KWe9OiDE4G is 37B 2020-04-28T12:48:50.424 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.438 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.KWe9OiDE4G 2020-04-28T12:48:50.490 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.543 INFO:teuthology.orchestra.run.smithi107:> mktemp 2020-04-28T12:48:50.596 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.kVLZSE0krS 2020-04-28T12:48:50.596 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.649 INFO:teuthology.orchestra.run.smithi107:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.kVLZSE0krS 2020-04-28T12:48:50.716 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.771 INFO:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.kVLZSE0krS 2020-04-28T12:48:50.895 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.kVLZSE0krS is 37B 2020-04-28T12:48:50.943 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:50.959 INFO:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.kVLZSE0krS 2020-04-28T12:48:51.009 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:51.062 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 9f6fc67c-475c-4623-80fa-31d94c5b936d 0 2020-04-28T12:48:51.371 INFO:teuthology.orchestra.run.smithi107.stdout:0 2020-04-28T12:48:51.382 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:51.395 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new ba2fb078-1574-40ca-8145-920991574328 1 2020-04-28T12:48:51.706 INFO:teuthology.orchestra.run.smithi107.stdout:1 2020-04-28T12:48:51.718 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:51.731 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new cae4b026-6362-4359-a7a9-a1869cda60ed 2 2020-04-28T12:48:52.042 INFO:teuthology.orchestra.run.smithi107.stdout:2 2020-04-28T12:48:52.054 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:52.067 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 5112957b-2b65-4d71-854d-fefa303a65ff 3 2020-04-28T12:48:52.376 INFO:teuthology.orchestra.run.smithi107.stdout:3 2020-04-28T12:48:52.388 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:52.401 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 39810416-f0b5-48ea-94ea-ace26bb90dce 4 2020-04-28T12:48:52.711 INFO:teuthology.orchestra.run.smithi107.stdout:4 2020-04-28T12:48:52.722 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:52.736 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 4895b826-22a2-4f22-9a44-b797d3dd00c1 5 2020-04-28T12:48:53.054 INFO:teuthology.orchestra.run.smithi107.stdout:5 2020-04-28T12:48:53.066 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:53.081 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new d60f35ac-6239-4c9f-9a6d-1d81236b6f90 6 2020-04-28T12:48:53.393 INFO:teuthology.orchestra.run.smithi107.stdout:6 2020-04-28T12:48:53.405 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:53.422 INFO:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 6a220517-f21e-4a7e-b368-a0446b8ae67a 7 2020-04-28T12:48:53.731 INFO:teuthology.orchestra.run.smithi107.stdout:7 2020-04-28T12:48:53.743 INFO:tasks.ceph.osd.0:Restarting daemon 2020-04-28T12:48:53.743 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:53.763 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-04-28T12:48:53.806 INFO:tasks.ceph.osd.0:Started 2020-04-28T12:48:53.806 INFO:tasks.ceph.osd.1:Restarting daemon 2020-04-28T12:48:53.806 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:53.823 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-04-28T12:48:53.866 INFO:tasks.ceph.osd.1:Started 2020-04-28T12:48:53.866 INFO:tasks.ceph.osd.2:Restarting daemon 2020-04-28T12:48:53.866 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:53.882 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-04-28T12:48:53.924 INFO:tasks.ceph.osd.2:Started 2020-04-28T12:48:53.925 INFO:tasks.ceph.osd.3:Restarting daemon 2020-04-28T12:48:53.925 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:53.940 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-04-28T12:48:53.983 INFO:tasks.ceph.osd.3:Started 2020-04-28T12:48:53.983 INFO:tasks.ceph.osd.4:Restarting daemon 2020-04-28T12:48:53.983 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:53.998 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-04-28T12:48:54.040 INFO:tasks.ceph.osd.4:Started 2020-04-28T12:48:54.040 INFO:tasks.ceph.osd.5:Restarting daemon 2020-04-28T12:48:54.041 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:54.054 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-04-28T12:48:54.098 INFO:tasks.ceph.osd.5:Started 2020-04-28T12:48:54.098 INFO:tasks.ceph.osd.6:Restarting daemon 2020-04-28T12:48:54.098 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:54.111 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-04-28T12:48:54.153 INFO:tasks.ceph.osd.6:Started 2020-04-28T12:48:54.154 INFO:tasks.ceph.osd.7:Restarting daemon 2020-04-28T12:48:54.154 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:48:54.167 INFO:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-04-28T12:48:54.210 INFO:tasks.ceph.osd.7:Started 2020-04-28T12:48:54.211 INFO:tasks.ceph:Waiting for OSDs to come up 2020-04-28T12:48:54.415 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T12:48:54.410+0000 7fd2bf163ec0 -1 Falling back to public interface 2020-04-28T12:48:54.470 INFO:tasks.ceph.osd.1.smithi026.stderr:2020-04-28T12:48:54.465+0000 7f3c677ddec0 -1 Falling back to public interface 2020-04-28T12:48:54.524 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T12:48:54.520+0000 7f4680463ec0 -1 Falling back to public interface 2020-04-28T12:48:54.578 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T12:48:54.574+0000 7f2bea744ec0 -1 Falling back to public interface 2020-04-28T12:48:54.631 INFO:tasks.ceph.osd.4.smithi107.stderr:2020-04-28T12:48:54.627+0000 7f8d41a88ec0 -1 Falling back to public interface 2020-04-28T12:48:54.688 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T12:48:54.684+0000 7f3a09f9aec0 -1 Falling back to public interface 2020-04-28T12:48:54.744 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T12:48:54.739+0000 7f75fb289ec0 -1 Falling back to public interface 2020-04-28T12:48:54.802 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T12:48:54.798+0000 7f0ff75d4ec0 -1 Falling back to public interface 2020-04-28T12:48:55.022 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:48:55.038 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:48:55.337 INFO:teuthology.misc.health.smithi026.stdout: 2020-04-28T12:48:55.338 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":11,"fsid":"00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de","created":"2020-04-28T12:48:46.711029+0000","modified":"2020-04-28T12:48:53.724361+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:48:49.754931+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"4","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9f6fc67c-475c-4623-80fa-31d94c5b936d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba2fb078-1574-40ca-8145-920991574328","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"cae4b026-6362-4359-a7a9-a1869cda60ed","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5112957b-2b65-4d71-854d-fefa303a65ff","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"39810416-f0b5-48ea-94ea-ace26bb90dce","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4895b826-22a2-4f22-9a44-b797d3dd00c1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d60f35ac-6239-4c9f-9a6d-1d81236b6f90","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a220517-f21e-4a7e-b368-a0446b8ae67a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:48:55.349 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-04-28T12:48:55.473 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T12:48:55.469+0000 7fd2bf163ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-04-28T12:48:55.533 INFO:tasks.ceph.osd.1.smithi026.stderr:2020-04-28T12:48:55.528+0000 7f3c677ddec0 -1 osd.1 0 log_to_monitors {default=true} 2020-04-28T12:48:55.591 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T12:48:55.587+0000 7f4680463ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-04-28T12:48:55.653 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T12:48:55.648+0000 7f2bea744ec0 -1 osd.3 0 log_to_monitors {default=true} 2020-04-28T12:48:55.700 INFO:tasks.ceph.osd.4.smithi107.stderr:2020-04-28T12:48:55.696+0000 7f8d41a88ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-04-28T12:48:55.757 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T12:48:55.752+0000 7f3a09f9aec0 -1 osd.5 0 log_to_monitors {default=true} 2020-04-28T12:48:55.805 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T12:48:55.801+0000 7f75fb289ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-04-28T12:48:55.879 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T12:48:55.875+0000 7f0ff75d4ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-04-28T12:48:57.401 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T12:48:57.397+0000 7fd2a792b700 -1 osd.0 0 waiting for initial osdmap 2020-04-28T12:48:57.402 INFO:tasks.ceph.osd.4.smithi107.stderr:2020-04-28T12:48:57.398+0000 7f8d2a250700 -1 osd.4 0 waiting for initial osdmap 2020-04-28T12:48:57.403 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T12:48:57.398+0000 7f75e3a51700 -1 osd.6 0 waiting for initial osdmap 2020-04-28T12:48:57.403 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T12:48:57.399+0000 7f0fdfd9c700 -1 osd.7 0 waiting for initial osdmap 2020-04-28T12:48:57.408 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T12:48:57.404+0000 7f4668c2b700 -1 osd.2 0 waiting for initial osdmap 2020-04-28T12:48:57.409 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T12:48:57.404+0000 7f39f2762700 -1 osd.5 0 waiting for initial osdmap 2020-04-28T12:48:57.409 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T12:48:57.404+0000 7f2bd2f0c700 -1 osd.3 0 waiting for initial osdmap 2020-04-28T12:48:57.409 INFO:tasks.ceph.osd.1.smithi026.stderr:2020-04-28T12:48:57.404+0000 7f3c4ffa5700 -1 osd.1 0 waiting for initial osdmap 2020-04-28T12:49:02.155 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:02.173 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-04-28T12:49:02.479 INFO:teuthology.misc.health.smithi026.stdout: 2020-04-28T12:49:02.479 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":16,"fsid":"00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de","created":"2020-04-28T12:48:46.711029+0000","modified":"2020-04-28T12:49:00.414796+0000","last_up_change":"2020-04-28T12:48:58.400674+0000","last_in_change":"2020-04-28T12:48:58.400674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:48:49.754931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9f6fc67c-475c-4623-80fa-31d94c5b936d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":23447},{"type":"v1","addr":"172.21.15.26:6801","nonce":23447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":23447},{"type":"v1","addr":"172.21.15.26:6803","nonce":23447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":23447},{"type":"v1","addr":"172.21.15.26:6807","nonce":23447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":23447},{"type":"v1","addr":"172.21.15.26:6805","nonce":23447}]},"public_addr":"172.21.15.26:6801/23447","cluster_addr":"172.21.15.26:6803/23447","heartbeat_back_addr":"172.21.15.26:6807/23447","heartbeat_front_addr":"172.21.15.26:6805/23447","state":["exists","up"]},{"osd":1,"uuid":"ba2fb078-1574-40ca-8145-920991574328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":23496},{"type":"v1","addr":"172.21.15.26:6809","nonce":23496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":23496},{"type":"v1","addr":"172.21.15.26:6811","nonce":23496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":23496},{"type":"v1","addr":"172.21.15.26:6815","nonce":23496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":23496},{"type":"v1","addr":"172.21.15.26:6813","nonce":23496}]},"public_addr":"172.21.15.26:6809/23496","cluster_addr":"172.21.15.26:6811/23496","heartbeat_back_addr":"172.21.15.26:6815/23496","heartbeat_front_addr":"172.21.15.26:6813/23496","state":["exists","up"]},{"osd":2,"uuid":"cae4b026-6362-4359-a7a9-a1869cda60ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":23527},{"type":"v1","addr":"172.21.15.26:6817","nonce":23527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":23527},{"type":"v1","addr":"172.21.15.26:6819","nonce":23527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":23527},{"type":"v1","addr":"172.21.15.26:6823","nonce":23527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":23527},{"type":"v1","addr":"172.21.15.26:6821","nonce":23527}]},"public_addr":"172.21.15.26:6817/23527","cluster_addr":"172.21.15.26:6819/23527","heartbeat_back_addr":"172.21.15.26:6823/23527","heartbeat_front_addr":"172.21.15.26:6821/23527","state":["exists","up"]},{"osd":3,"uuid":"5112957b-2b65-4d71-854d-fefa303a65ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":23547},{"type":"v1","addr":"172.21.15.26:6825","nonce":23547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":23547},{"type":"v1","addr":"172.21.15.26:6827","nonce":23547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":23547},{"type":"v1","addr":"172.21.15.26:6831","nonce":23547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":23547},{"type":"v1","addr":"172.21.15.26:6829","nonce":23547}]},"public_addr":"172.21.15.26:6825/23547","cluster_addr":"172.21.15.26:6827/23547","heartbeat_back_addr":"172.21.15.26:6831/23547","heartbeat_front_addr":"172.21.15.26:6829/23547","state":["exists","up"]},{"osd":4,"uuid":"39810416-f0b5-48ea-94ea-ace26bb90dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":23415},{"type":"v1","addr":"172.21.15.107:6803","nonce":23415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":23415},{"type":"v1","addr":"172.21.15.107:6805","nonce":23415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":23415},{"type":"v1","addr":"172.21.15.107:6809","nonce":23415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":23415},{"type":"v1","addr":"172.21.15.107:6807","nonce":23415}]},"public_addr":"172.21.15.107:6803/23415","cluster_addr":"172.21.15.107:6805/23415","heartbeat_back_addr":"172.21.15.107:6809/23415","heartbeat_front_addr":"172.21.15.107:6807/23415","state":["exists","up"]},{"osd":5,"uuid":"4895b826-22a2-4f22-9a44-b797d3dd00c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":23470},{"type":"v1","addr":"172.21.15.107:6811","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":23470},{"type":"v1","addr":"172.21.15.107:6813","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":23470},{"type":"v1","addr":"172.21.15.107:6817","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":23470},{"type":"v1","addr":"172.21.15.107:6815","nonce":23470}]},"public_addr":"172.21.15.107:6811/23470","cluster_addr":"172.21.15.107:6813/23470","heartbeat_back_addr":"172.21.15.107:6817/23470","heartbeat_front_addr":"172.21.15.107:6815/23470","state":["exists","up"]},{"osd":6,"uuid":"d60f35ac-6239-4c9f-9a6d-1d81236b6f90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":23511},{"type":"v1","addr":"172.21.15.107:6819","nonce":23511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":23511},{"type":"v1","addr":"172.21.15.107:6821","nonce":23511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":23511},{"type":"v1","addr":"172.21.15.107:6825","nonce":23511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":23511},{"type":"v1","addr":"172.21.15.107:6823","nonce":23511}]},"public_addr":"172.21.15.107:6819/23511","cluster_addr":"172.21.15.107:6821/23511","heartbeat_back_addr":"172.21.15.107:6825/23511","heartbeat_front_addr":"172.21.15.107:6823/23511","state":["exists","up"]},{"osd":7,"uuid":"6a220517-f21e-4a7e-b368-a0446b8ae67a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":23539},{"type":"v1","addr":"172.21.15.107:6827","nonce":23539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":23539},{"type":"v1","addr":"172.21.15.107:6829","nonce":23539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":23539},{"type":"v1","addr":"172.21.15.107:6833","nonce":23539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":23539},{"type":"v1","addr":"172.21.15.107:6831","nonce":23539}]},"public_addr":"172.21.15.107:6827/23539","cluster_addr":"172.21.15.107:6829/23539","heartbeat_back_addr":"172.21.15.107:6833/23539","heartbeat_front_addr":"172.21.15.107:6831/23539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.426120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.563267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.606046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.655649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.726128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.801586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.755685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.858190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:49:02.490 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-04-28T12:49:02.490 INFO:tasks.ceph:Creating RBD pool 2020-04-28T12:49:02.490 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:02.504 INFO:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool create rbd 8 2020-04-28T12:49:03.505 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'rbd' created 2020-04-28T12:49:03.517 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:03.533 INFO:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-04-28T12:49:04.510 INFO:teuthology.orchestra.run.smithi026.stderr:enabled application 'rbd' on pool 'rbd' 2020-04-28T12:49:04.522 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-04-28T12:49:04.523 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:04.523 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-04-28T12:49:04.538 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:49:04.857 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:49:04.857 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"fsid":"00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de","created":"2020-04-28T12:48:46.711029+0000","modified":"2020-04-28T12:49:04.495343+0000","last_up_change":"2020-04-28T12:48:58.400674+0000","last_in_change":"2020-04-28T12:48:58.400674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:48:49.754931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:49:02.823170+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9f6fc67c-475c-4623-80fa-31d94c5b936d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":23447},{"type":"v1","addr":"172.21.15.26:6801","nonce":23447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":23447},{"type":"v1","addr":"172.21.15.26:6803","nonce":23447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":23447},{"type":"v1","addr":"172.21.15.26:6807","nonce":23447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":23447},{"type":"v1","addr":"172.21.15.26:6805","nonce":23447}]},"public_addr":"172.21.15.26:6801/23447","cluster_addr":"172.21.15.26:6803/23447","heartbeat_back_addr":"172.21.15.26:6807/23447","heartbeat_front_addr":"172.21.15.26:6805/23447","state":["exists","up"]},{"osd":1,"uuid":"ba2fb078-1574-40ca-8145-920991574328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":23496},{"type":"v1","addr":"172.21.15.26:6809","nonce":23496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":23496},{"type":"v1","addr":"172.21.15.26:6811","nonce":23496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":23496},{"type":"v1","addr":"172.21.15.26:6815","nonce":23496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":23496},{"type":"v1","addr":"172.21.15.26:6813","nonce":23496}]},"public_addr":"172.21.15.26:6809/23496","cluster_addr":"172.21.15.26:6811/23496","heartbeat_back_addr":"172.21.15.26:6815/23496","heartbeat_front_addr":"172.21.15.26:6813/23496","state":["exists","up"]},{"osd":2,"uuid":"cae4b026-6362-4359-a7a9-a1869cda60ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":23527},{"type":"v1","addr":"172.21.15.26:6817","nonce":23527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":23527},{"type":"v1","addr":"172.21.15.26:6819","nonce":23527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":23527},{"type":"v1","addr":"172.21.15.26:6823","nonce":23527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":23527},{"type":"v1","addr":"172.21.15.26:6821","nonce":23527}]},"public_addr":"172.21.15.26:6817/23527","cluster_addr":"172.21.15.26:6819/23527","heartbeat_back_addr":"172.21.15.26:6823/23527","heartbeat_front_addr":"172.21.15.26:6821/23527","state":["exists","up"]},{"osd":3,"uuid":"5112957b-2b65-4d71-854d-fefa303a65ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":23547},{"type":"v1","addr":"172.21.15.26:6825","nonce":23547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":23547},{"type":"v1","addr":"172.21.15.26:6827","nonce":23547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":23547},{"type":"v1","addr":"172.21.15.26:6831","nonce":23547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":23547},{"type":"v1","addr":"172.21.15.26:6829","nonce":23547}]},"public_addr":"172.21.15.26:6825/23547","cluster_addr":"172.21.15.26:6827/23547","heartbeat_back_addr":"172.21.15.26:6831/23547","heartbeat_front_addr":"172.21.15.26:6829/23547","state":["exists","up"]},{"osd":4,"uuid":"39810416-f0b5-48ea-94ea-ace26bb90dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":23415},{"type":"v1","addr":"172.21.15.107:6803","nonce":23415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":23415},{"type":"v1","addr":"172.21.15.107:6805","nonce":23415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":23415},{"type":"v1","addr":"172.21.15.107:6809","nonce":23415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":23415},{"type":"v1","addr":"172.21.15.107:6807","nonce":23415}]},"public_addr":"172.21.15.107:6803/23415","cluster_addr":"172.21.15.107:6805/23415","heartbeat_back_addr":"172.21.15.107:6809/23415","heartbeat_front_addr":"172.21.15.107:6807/23415","state":["exists","up"]},{"osd":5,"uuid":"4895b826-22a2-4f22-9a44-b797d3dd00c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":23470},{"type":"v1","addr":"172.21.15.107:6811","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":23470},{"type":"v1","addr":"172.21.15.107:6813","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":23470},{"type":"v1","addr":"172.21.15.107:6817","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":23470},{"type":"v1","addr":"172.21.15.107:6815","nonce":23470}]},"public_addr":"172.21.15.107:6811/23470","cluster_addr":"172.21.15.107:6813/23470","heartbeat_back_addr":"172.21.15.107:6817/23470","heartbeat_front_addr":"172.21.15.107:6815/23470","state":["exists","up"]},{"osd":6,"uuid":"d60f35ac-6239-4c9f-9a6d-1d81236b6f90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":23511},{"type":"v1","addr":"172.21.15.107:6819","nonce":23511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":23511},{"type":"v1","addr":"172.21.15.107:6821","nonce":23511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":23511},{"type":"v1","addr":"172.21.15.107:6825","nonce":23511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":23511},{"type":"v1","addr":"172.21.15.107:6823","nonce":23511}]},"public_addr":"172.21.15.107:6819/23511","cluster_addr":"172.21.15.107:6821/23511","heartbeat_back_addr":"172.21.15.107:6825/23511","heartbeat_front_addr":"172.21.15.107:6823/23511","state":["exists","up"]},{"osd":7,"uuid":"6a220517-f21e-4a7e-b368-a0446b8ae67a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":23539},{"type":"v1","addr":"172.21.15.107:6827","nonce":23539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":23539},{"type":"v1","addr":"172.21.15.107:6829","nonce":23539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":23539},{"type":"v1","addr":"172.21.15.107:6833","nonce":23539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":23539},{"type":"v1","addr":"172.21.15.107:6831","nonce":23539}]},"public_addr":"172.21.15.107:6827/23539","cluster_addr":"172.21.15.107:6829/23539","heartbeat_back_addr":"172.21.15.107:6833/23539","heartbeat_front_addr":"172.21.15.107:6831/23539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.426120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.563267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.606046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.655649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.726128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.801586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.755685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.858190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:49:04.869 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 1, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:48:49.754931+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 1, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 1, u'pg_num': 1, u'type': 1, u'grade_table': [], u'pool_name': u'device_health_metrics', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 1, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'mgr_devicehealth': {}}, u'options': {u'pg_num_min': 1}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-04-28T12:49:02.823170+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-04-28T12:49:04.869 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:04.883 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-04-28T12:49:05.201 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2020-04-28T12:49:05.212 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:05.226 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-04-28T12:49:05.542 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2020-04-28T12:49:05.553 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-04-28T12:49:05.554 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-04-28T12:49:05.554 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:05.567 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-04-28T12:49:05.921 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:49:05.932 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":22171},{"type":"v1","addr":"172.21.15.107:6801","nonce":22171}]},"active_addr":"172.21.15.107:6801/22171","active_change":"2020-04-28T12:48:49.729828+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2087645165}]},{"addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3644331685}]},{"addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1248636585}]}]}} 2020-04-28T12:49:05.940 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-04-28T12:49:05.940 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-04-28T12:49:05.941 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:05.955 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:49:06.266 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:49:06.266 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"fsid":"00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de","created":"2020-04-28T12:48:46.711029+0000","modified":"2020-04-28T12:49:05.500049+0000","last_up_change":"2020-04-28T12:48:58.400674+0000","last_in_change":"2020-04-28T12:48:58.400674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:48:49.754931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:49:02.823170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9f6fc67c-475c-4623-80fa-31d94c5b936d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":23447},{"type":"v1","addr":"172.21.15.26:6801","nonce":23447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":23447},{"type":"v1","addr":"172.21.15.26:6803","nonce":23447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":23447},{"type":"v1","addr":"172.21.15.26:6807","nonce":23447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":23447},{"type":"v1","addr":"172.21.15.26:6805","nonce":23447}]},"public_addr":"172.21.15.26:6801/23447","cluster_addr":"172.21.15.26:6803/23447","heartbeat_back_addr":"172.21.15.26:6807/23447","heartbeat_front_addr":"172.21.15.26:6805/23447","state":["exists","up"]},{"osd":1,"uuid":"ba2fb078-1574-40ca-8145-920991574328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":23496},{"type":"v1","addr":"172.21.15.26:6809","nonce":23496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":23496},{"type":"v1","addr":"172.21.15.26:6811","nonce":23496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":23496},{"type":"v1","addr":"172.21.15.26:6815","nonce":23496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":23496},{"type":"v1","addr":"172.21.15.26:6813","nonce":23496}]},"public_addr":"172.21.15.26:6809/23496","cluster_addr":"172.21.15.26:6811/23496","heartbeat_back_addr":"172.21.15.26:6815/23496","heartbeat_front_addr":"172.21.15.26:6813/23496","state":["exists","up"]},{"osd":2,"uuid":"cae4b026-6362-4359-a7a9-a1869cda60ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":23527},{"type":"v1","addr":"172.21.15.26:6817","nonce":23527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":23527},{"type":"v1","addr":"172.21.15.26:6819","nonce":23527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":23527},{"type":"v1","addr":"172.21.15.26:6823","nonce":23527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":23527},{"type":"v1","addr":"172.21.15.26:6821","nonce":23527}]},"public_addr":"172.21.15.26:6817/23527","cluster_addr":"172.21.15.26:6819/23527","heartbeat_back_addr":"172.21.15.26:6823/23527","heartbeat_front_addr":"172.21.15.26:6821/23527","state":["exists","up"]},{"osd":3,"uuid":"5112957b-2b65-4d71-854d-fefa303a65ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":23547},{"type":"v1","addr":"172.21.15.26:6825","nonce":23547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":23547},{"type":"v1","addr":"172.21.15.26:6827","nonce":23547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":23547},{"type":"v1","addr":"172.21.15.26:6831","nonce":23547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":23547},{"type":"v1","addr":"172.21.15.26:6829","nonce":23547}]},"public_addr":"172.21.15.26:6825/23547","cluster_addr":"172.21.15.26:6827/23547","heartbeat_back_addr":"172.21.15.26:6831/23547","heartbeat_front_addr":"172.21.15.26:6829/23547","state":["exists","up"]},{"osd":4,"uuid":"39810416-f0b5-48ea-94ea-ace26bb90dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":23415},{"type":"v1","addr":"172.21.15.107:6803","nonce":23415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":23415},{"type":"v1","addr":"172.21.15.107:6805","nonce":23415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":23415},{"type":"v1","addr":"172.21.15.107:6809","nonce":23415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":23415},{"type":"v1","addr":"172.21.15.107:6807","nonce":23415}]},"public_addr":"172.21.15.107:6803/23415","cluster_addr":"172.21.15.107:6805/23415","heartbeat_back_addr":"172.21.15.107:6809/23415","heartbeat_front_addr":"172.21.15.107:6807/23415","state":["exists","up"]},{"osd":5,"uuid":"4895b826-22a2-4f22-9a44-b797d3dd00c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":23470},{"type":"v1","addr":"172.21.15.107:6811","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":23470},{"type":"v1","addr":"172.21.15.107:6813","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":23470},{"type":"v1","addr":"172.21.15.107:6817","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":23470},{"type":"v1","addr":"172.21.15.107:6815","nonce":23470}]},"public_addr":"172.21.15.107:6811/23470","cluster_addr":"172.21.15.107:6813/23470","heartbeat_back_addr":"172.21.15.107:6817/23470","heartbeat_front_addr":"172.21.15.107:6815/23470","state":["exists","up"]},{"osd":6,"uuid":"d60f35ac-6239-4c9f-9a6d-1d81236b6f90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":23511},{"type":"v1","addr":"172.21.15.107:6819","nonce":23511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":23511},{"type":"v1","addr":"172.21.15.107:6821","nonce":23511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":23511},{"type":"v1","addr":"172.21.15.107:6825","nonce":23511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":23511},{"type":"v1","addr":"172.21.15.107:6823","nonce":23511}]},"public_addr":"172.21.15.107:6819/23511","cluster_addr":"172.21.15.107:6821/23511","heartbeat_back_addr":"172.21.15.107:6825/23511","heartbeat_front_addr":"172.21.15.107:6823/23511","state":["exists","up"]},{"osd":7,"uuid":"6a220517-f21e-4a7e-b368-a0446b8ae67a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":23539},{"type":"v1","addr":"172.21.15.107:6827","nonce":23539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":23539},{"type":"v1","addr":"172.21.15.107:6829","nonce":23539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":23539},{"type":"v1","addr":"172.21.15.107:6833","nonce":23539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":23539},{"type":"v1","addr":"172.21.15.107:6831","nonce":23539}]},"public_addr":"172.21.15.107:6827/23539","cluster_addr":"172.21.15.107:6829/23539","heartbeat_back_addr":"172.21.15.107:6833/23539","heartbeat_front_addr":"172.21.15.107:6831/23539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.426120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.563267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.606046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.655649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.726128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.801586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.755685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.858190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:49:06.278 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-04-28T12:49:06.278 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:06.292 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-04-28T12:49:06.608 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:49:06.608 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"fsid":"00f7f600-cf0f-4cc3-a7c6-47ce80ecd0de","created":"2020-04-28T12:48:46.711029+0000","modified":"2020-04-28T12:49:05.500049+0000","last_up_change":"2020-04-28T12:48:58.400674+0000","last_in_change":"2020-04-28T12:48:58.400674+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-04-28T12:48:49.754931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-04-28T12:49:02.823170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9f6fc67c-475c-4623-80fa-31d94c5b936d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":23447},{"type":"v1","addr":"172.21.15.26:6801","nonce":23447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":23447},{"type":"v1","addr":"172.21.15.26:6803","nonce":23447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":23447},{"type":"v1","addr":"172.21.15.26:6807","nonce":23447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":23447},{"type":"v1","addr":"172.21.15.26:6805","nonce":23447}]},"public_addr":"172.21.15.26:6801/23447","cluster_addr":"172.21.15.26:6803/23447","heartbeat_back_addr":"172.21.15.26:6807/23447","heartbeat_front_addr":"172.21.15.26:6805/23447","state":["exists","up"]},{"osd":1,"uuid":"ba2fb078-1574-40ca-8145-920991574328","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":23496},{"type":"v1","addr":"172.21.15.26:6809","nonce":23496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":23496},{"type":"v1","addr":"172.21.15.26:6811","nonce":23496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":23496},{"type":"v1","addr":"172.21.15.26:6815","nonce":23496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":23496},{"type":"v1","addr":"172.21.15.26:6813","nonce":23496}]},"public_addr":"172.21.15.26:6809/23496","cluster_addr":"172.21.15.26:6811/23496","heartbeat_back_addr":"172.21.15.26:6815/23496","heartbeat_front_addr":"172.21.15.26:6813/23496","state":["exists","up"]},{"osd":2,"uuid":"cae4b026-6362-4359-a7a9-a1869cda60ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":23527},{"type":"v1","addr":"172.21.15.26:6817","nonce":23527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":23527},{"type":"v1","addr":"172.21.15.26:6819","nonce":23527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":23527},{"type":"v1","addr":"172.21.15.26:6823","nonce":23527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":23527},{"type":"v1","addr":"172.21.15.26:6821","nonce":23527}]},"public_addr":"172.21.15.26:6817/23527","cluster_addr":"172.21.15.26:6819/23527","heartbeat_back_addr":"172.21.15.26:6823/23527","heartbeat_front_addr":"172.21.15.26:6821/23527","state":["exists","up"]},{"osd":3,"uuid":"5112957b-2b65-4d71-854d-fefa303a65ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":23547},{"type":"v1","addr":"172.21.15.26:6825","nonce":23547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":23547},{"type":"v1","addr":"172.21.15.26:6827","nonce":23547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":23547},{"type":"v1","addr":"172.21.15.26:6831","nonce":23547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":23547},{"type":"v1","addr":"172.21.15.26:6829","nonce":23547}]},"public_addr":"172.21.15.26:6825/23547","cluster_addr":"172.21.15.26:6827/23547","heartbeat_back_addr":"172.21.15.26:6831/23547","heartbeat_front_addr":"172.21.15.26:6829/23547","state":["exists","up"]},{"osd":4,"uuid":"39810416-f0b5-48ea-94ea-ace26bb90dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":23415},{"type":"v1","addr":"172.21.15.107:6803","nonce":23415}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":23415},{"type":"v1","addr":"172.21.15.107:6805","nonce":23415}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":23415},{"type":"v1","addr":"172.21.15.107:6809","nonce":23415}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":23415},{"type":"v1","addr":"172.21.15.107:6807","nonce":23415}]},"public_addr":"172.21.15.107:6803/23415","cluster_addr":"172.21.15.107:6805/23415","heartbeat_back_addr":"172.21.15.107:6809/23415","heartbeat_front_addr":"172.21.15.107:6807/23415","state":["exists","up"]},{"osd":5,"uuid":"4895b826-22a2-4f22-9a44-b797d3dd00c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":23470},{"type":"v1","addr":"172.21.15.107:6811","nonce":23470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":23470},{"type":"v1","addr":"172.21.15.107:6813","nonce":23470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":23470},{"type":"v1","addr":"172.21.15.107:6817","nonce":23470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":23470},{"type":"v1","addr":"172.21.15.107:6815","nonce":23470}]},"public_addr":"172.21.15.107:6811/23470","cluster_addr":"172.21.15.107:6813/23470","heartbeat_back_addr":"172.21.15.107:6817/23470","heartbeat_front_addr":"172.21.15.107:6815/23470","state":["exists","up"]},{"osd":6,"uuid":"d60f35ac-6239-4c9f-9a6d-1d81236b6f90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":23511},{"type":"v1","addr":"172.21.15.107:6819","nonce":23511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":23511},{"type":"v1","addr":"172.21.15.107:6821","nonce":23511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":23511},{"type":"v1","addr":"172.21.15.107:6825","nonce":23511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":23511},{"type":"v1","addr":"172.21.15.107:6823","nonce":23511}]},"public_addr":"172.21.15.107:6819/23511","cluster_addr":"172.21.15.107:6821/23511","heartbeat_back_addr":"172.21.15.107:6825/23511","heartbeat_front_addr":"172.21.15.107:6823/23511","state":["exists","up"]},{"osd":7,"uuid":"6a220517-f21e-4a7e-b368-a0446b8ae67a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":23539},{"type":"v1","addr":"172.21.15.107:6827","nonce":23539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":23539},{"type":"v1","addr":"172.21.15.107:6829","nonce":23539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":23539},{"type":"v1","addr":"172.21.15.107:6833","nonce":23539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":23539},{"type":"v1","addr":"172.21.15.107:6831","nonce":23539}]},"public_addr":"172.21.15.107:6827/23539","cluster_addr":"172.21.15.107:6829/23539","heartbeat_back_addr":"172.21.15.107:6833/23539","heartbeat_front_addr":"172.21.15.107:6831/23539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.426120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.563267+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.606046+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.655649+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.726128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.801586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.755685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-04-28T12:48:56.858190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-04-28T12:49:06.620 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:06.634 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-04-28T12:49:06.825 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:06.825 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:06.839 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-04-28T12:49:07.028 INFO:teuthology.orchestra.run.smithi026.stdout:60129542149 2020-04-28T12:49:07.029 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:07.043 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-04-28T12:49:07.232 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:07.232 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:07.246 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-04-28T12:49:07.436 INFO:teuthology.orchestra.run.smithi026.stdout:60129542147 2020-04-28T12:49:07.436 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:07.450 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-04-28T12:49:07.641 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:07.642 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:07.656 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-04-28T12:49:07.847 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:07.848 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:07.862 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-04-28T12:49:08.063 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:08.064 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:08.079 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-04-28T12:49:08.269 INFO:teuthology.orchestra.run.smithi026.stdout:60129542147 2020-04-28T12:49:08.269 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:08.283 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-04-28T12:49:08.597 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:08.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2020-04-28T12:49:08.608 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:08.623 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-04-28T12:49:08.933 INFO:teuthology.orchestra.run.smithi026.stdout:60129542149 2020-04-28T12:49:08.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2020-04-28T12:49:08.945 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:08.959 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-04-28T12:49:09.280 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:09.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2020-04-28T12:49:09.292 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:09.305 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-04-28T12:49:09.619 INFO:teuthology.orchestra.run.smithi026.stdout:60129542147 2020-04-28T12:49:09.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2020-04-28T12:49:09.631 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:09.648 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-04-28T12:49:09.958 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:09.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2020-04-28T12:49:09.970 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:09.983 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-28T12:49:10.295 INFO:teuthology.orchestra.run.smithi026.stdout:60129542147 2020-04-28T12:49:10.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.5 2020-04-28T12:49:11.307 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:11.324 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-04-28T12:49:11.647 INFO:teuthology.orchestra.run.smithi026.stdout:60129542149 2020-04-28T12:49:11.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.5 2020-04-28T12:49:11.659 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:11.673 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-04-28T12:49:11.984 INFO:teuthology.orchestra.run.smithi026.stdout:60129542149 2020-04-28T12:49:11.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.6 2020-04-28T12:49:11.995 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:12.009 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-04-28T12:49:12.321 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2020-04-28T12:49:12.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542148 for osd.7 2020-04-28T12:49:12.333 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-04-28T12:49:12.333 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:12.347 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:49:12.656 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:49:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2020-04-28T12:49:12.667 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2020-04-28T12:49:11.736847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8390144,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584576,"statfs":{"total":773094113280,"available":764502605824,"internally_reserved":8589934592,"allocated":1507328,"data_stored":512864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.234339"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.505463+0000","last_change":"2020-04-28T12:49:04.505061+0000","last_active":"2020-04-28T12:49:04.505463+0000","last_peered":"2020-04-28T12:49:04.505463+0000","last_clean":"2020-04-28T12:49:04.505463+0000","last_became_active":"2020-04-28T12:49:04.504553+0000","last_became_peered":"2020-04-28T12:49:04.504553+0000","last_unstale":"2020-04-28T12:49:04.505463+0000","last_undegraded":"2020-04-28T12:49:04.505463+0000","last_fullsized":"2020-04-28T12:49:04.505463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.508858+0000","last_change":"2020-04-28T12:49:04.508290+0000","last_active":"2020-04-28T12:49:04.508858+0000","last_peered":"2020-04-28T12:49:04.508858+0000","last_clean":"2020-04-28T12:49:04.508858+0000","last_became_active":"2020-04-28T12:49:04.507901+0000","last_became_peered":"2020-04-28T12:49:04.507901+0000","last_unstale":"2020-04-28T12:49:04.508858+0000","last_undegraded":"2020-04-28T12:49:04.508858+0000","last_fullsized":"2020-04-28T12:49:04.508858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:05.482932+0000","last_change":"2020-04-28T12:49:05.482639+0000","last_active":"2020-04-28T12:49:05.482932+0000","last_peered":"2020-04-28T12:49:05.482932+0000","last_clean":"2020-04-28T12:49:05.482932+0000","last_became_active":"2020-04-28T12:49:05.482223+0000","last_became_peered":"2020-04-28T12:49:05.482223+0000","last_unstale":"2020-04-28T12:49:05.482932+0000","last_undegraded":"2020-04-28T12:49:05.482932+0000","last_fullsized":"2020-04-28T12:49:05.482932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.507537+0000","last_change":"2020-04-28T12:49:04.507262+0000","last_active":"2020-04-28T12:49:04.507537+0000","last_peered":"2020-04-28T12:49:04.507537+0000","last_clean":"2020-04-28T12:49:04.507537+0000","last_became_active":"2020-04-28T12:49:04.506813+0000","last_became_peered":"2020-04-28T12:49:04.506813+0000","last_unstale":"2020-04-28T12:49:04.507537+0000","last_undegraded":"2020-04-28T12:49:04.507537+0000","last_fullsized":"2020-04-28T12:49:04.507537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.503313+0000","last_change":"2020-04-28T12:48:59.419848+0000","last_active":"2020-04-28T12:49:04.503313+0000","last_peered":"2020-04-28T12:49:04.503313+0000","last_clean":"2020-04-28T12:49:04.503313+0000","last_became_active":"2020-04-28T12:48:59.419448+0000","last_became_peered":"2020-04-28T12:48:59.419448+0000","last_unstale":"2020-04-28T12:49:04.503313+0000","last_undegraded":"2020-04-28T12:49:04.503313+0000","last_fullsized":"2020-04-28T12:49:04.503313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:48:50.732007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:48:50.732007+0000","last_clean_scrub_stamp":"2020-04-28T12:48:50.732007+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.510692+0000","last_change":"2020-04-28T12:49:04.510362+0000","last_active":"2020-04-28T12:49:04.510692+0000","last_peered":"2020-04-28T12:49:04.510692+0000","last_clean":"2020-04-28T12:49:04.510692+0000","last_became_active":"2020-04-28T12:49:04.509975+0000","last_became_peered":"2020-04-28T12:49:04.509975+0000","last_unstale":"2020-04-28T12:49:04.510692+0000","last_undegraded":"2020-04-28T12:49:04.510692+0000","last_fullsized":"2020-04-28T12:49:04.510692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.509210+0000","last_change":"2020-04-28T12:49:04.507666+0000","last_active":"2020-04-28T12:49:04.509210+0000","last_peered":"2020-04-28T12:49:04.509210+0000","last_clean":"2020-04-28T12:49:04.509210+0000","last_became_active":"2020-04-28T12:49:04.507182+0000","last_became_peered":"2020-04-28T12:49:04.507182+0000","last_unstale":"2020-04-28T12:49:04.509210+0000","last_undegraded":"2020-04-28T12:49:04.509210+0000","last_fullsized":"2020-04-28T12:49:04.509210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.510558+0000","last_change":"2020-04-28T12:49:04.510123+0000","last_active":"2020-04-28T12:49:04.510558+0000","last_peered":"2020-04-28T12:49:04.510558+0000","last_clean":"2020-04-28T12:49:04.510558+0000","last_became_active":"2020-04-28T12:49:04.509614+0000","last_became_peered":"2020-04-28T12:49:04.509614+0000","last_unstale":"2020-04-28T12:49:04.510558+0000","last_undegraded":"2020-04-28T12:49:04.510558+0000","last_fullsized":"2020-04-28T12:49:04.510558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:05.482758+0000","last_change":"2020-04-28T12:49:05.482488+0000","last_active":"2020-04-28T12:49:05.482758+0000","last_peered":"2020-04-28T12:49:05.482758+0000","last_clean":"2020-04-28T12:49:05.482758+0000","last_became_active":"2020-04-28T12:49:05.482002+0000","last_became_peered":"2020-04-28T12:49:05.482002+0000","last_unstale":"2020-04-28T12:49:05.482758+0000","last_undegraded":"2020-04-28T12:49:05.482758+0000","last_fullsized":"2020-04-28T12:49:05.482758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6919999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.718}]}]}]}} 2020-04-28T12:49:12.669 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:12.683 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-04-28T12:49:12.989 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:49:12.991 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2020-04-28T12:49:13.001 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2020-04-28T12:49:11.736847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8390144,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584576,"statfs":{"total":773094113280,"available":764502605824,"internally_reserved":8589934592,"allocated":1507328,"data_stored":512864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.234339"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.505463+0000","last_change":"2020-04-28T12:49:04.505061+0000","last_active":"2020-04-28T12:49:04.505463+0000","last_peered":"2020-04-28T12:49:04.505463+0000","last_clean":"2020-04-28T12:49:04.505463+0000","last_became_active":"2020-04-28T12:49:04.504553+0000","last_became_peered":"2020-04-28T12:49:04.504553+0000","last_unstale":"2020-04-28T12:49:04.505463+0000","last_undegraded":"2020-04-28T12:49:04.505463+0000","last_fullsized":"2020-04-28T12:49:04.505463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.508858+0000","last_change":"2020-04-28T12:49:04.508290+0000","last_active":"2020-04-28T12:49:04.508858+0000","last_peered":"2020-04-28T12:49:04.508858+0000","last_clean":"2020-04-28T12:49:04.508858+0000","last_became_active":"2020-04-28T12:49:04.507901+0000","last_became_peered":"2020-04-28T12:49:04.507901+0000","last_unstale":"2020-04-28T12:49:04.508858+0000","last_undegraded":"2020-04-28T12:49:04.508858+0000","last_fullsized":"2020-04-28T12:49:04.508858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:05.482932+0000","last_change":"2020-04-28T12:49:05.482639+0000","last_active":"2020-04-28T12:49:05.482932+0000","last_peered":"2020-04-28T12:49:05.482932+0000","last_clean":"2020-04-28T12:49:05.482932+0000","last_became_active":"2020-04-28T12:49:05.482223+0000","last_became_peered":"2020-04-28T12:49:05.482223+0000","last_unstale":"2020-04-28T12:49:05.482932+0000","last_undegraded":"2020-04-28T12:49:05.482932+0000","last_fullsized":"2020-04-28T12:49:05.482932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.507537+0000","last_change":"2020-04-28T12:49:04.507262+0000","last_active":"2020-04-28T12:49:04.507537+0000","last_peered":"2020-04-28T12:49:04.507537+0000","last_clean":"2020-04-28T12:49:04.507537+0000","last_became_active":"2020-04-28T12:49:04.506813+0000","last_became_peered":"2020-04-28T12:49:04.506813+0000","last_unstale":"2020-04-28T12:49:04.507537+0000","last_undegraded":"2020-04-28T12:49:04.507537+0000","last_fullsized":"2020-04-28T12:49:04.507537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"14","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.503313+0000","last_change":"2020-04-28T12:48:59.419848+0000","last_active":"2020-04-28T12:49:04.503313+0000","last_peered":"2020-04-28T12:49:04.503313+0000","last_clean":"2020-04-28T12:49:04.503313+0000","last_became_active":"2020-04-28T12:48:59.419448+0000","last_became_peered":"2020-04-28T12:48:59.419448+0000","last_unstale":"2020-04-28T12:49:04.503313+0000","last_undegraded":"2020-04-28T12:49:04.503313+0000","last_fullsized":"2020-04-28T12:49:04.503313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":3,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:48:50.732007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:48:50.732007+0000","last_clean_scrub_stamp":"2020-04-28T12:48:50.732007+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.510692+0000","last_change":"2020-04-28T12:49:04.510362+0000","last_active":"2020-04-28T12:49:04.510692+0000","last_peered":"2020-04-28T12:49:04.510692+0000","last_clean":"2020-04-28T12:49:04.510692+0000","last_became_active":"2020-04-28T12:49:04.509975+0000","last_became_peered":"2020-04-28T12:49:04.509975+0000","last_unstale":"2020-04-28T12:49:04.510692+0000","last_undegraded":"2020-04-28T12:49:04.510692+0000","last_fullsized":"2020-04-28T12:49:04.510692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.509210+0000","last_change":"2020-04-28T12:49:04.507666+0000","last_active":"2020-04-28T12:49:04.509210+0000","last_peered":"2020-04-28T12:49:04.509210+0000","last_clean":"2020-04-28T12:49:04.509210+0000","last_became_active":"2020-04-28T12:49:04.507182+0000","last_became_peered":"2020-04-28T12:49:04.507182+0000","last_unstale":"2020-04-28T12:49:04.509210+0000","last_undegraded":"2020-04-28T12:49:04.509210+0000","last_fullsized":"2020-04-28T12:49:04.509210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:04.510558+0000","last_change":"2020-04-28T12:49:04.510123+0000","last_active":"2020-04-28T12:49:04.510558+0000","last_peered":"2020-04-28T12:49:04.510558+0000","last_clean":"2020-04-28T12:49:04.510558+0000","last_became_active":"2020-04-28T12:49:04.509614+0000","last_became_peered":"2020-04-28T12:49:04.509614+0000","last_unstale":"2020-04-28T12:49:04.510558+0000","last_undegraded":"2020-04-28T12:49:04.510558+0000","last_fullsized":"2020-04-28T12:49:04.510558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"9","reported_epoch":"18","state":"active+clean","last_fresh":"2020-04-28T12:49:05.482758+0000","last_change":"2020-04-28T12:49:05.482488+0000","last_active":"2020-04-28T12:49:05.482758+0000","last_peered":"2020-04-28T12:49:05.482758+0000","last_clean":"2020-04-28T12:49:05.482758+0000","last_became_active":"2020-04-28T12:49:05.482002+0000","last_became_peered":"2020-04-28T12:49:05.482002+0000","last_unstale":"2020-04-28T12:49:05.482758+0000","last_undegraded":"2020-04-28T12:49:05.482758+0000","last_fullsized":"2020-04-28T12:49:05.482758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-04-28T12:49:03.490289+0000","last_clean_scrub_stamp":"2020-04-28T12:49:03.490289+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":64108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6919999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.718}]}]}]}} 2020-04-28T12:49:13.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-04-28T12:49:13.003 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-04-28T12:49:13.003 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-04-28T12:49:13.004 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:13.017 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-04-28T12:49:13.378 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:49:13.390 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-04-28T12:49:13.390 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-04-28T12:49:13.390 INFO:teuthology.run_tasks:Running task openssl_keys... 2020-04-28T12:49:13.416 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.1': {'ca': 'root', 'client': 'client.1', 'embed-key': True}, 'root': {'key-type': 'rsa:4096', 'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0', 'client.1']}, 'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}} 2020-04-28T12:49:13.416 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:13.431 INFO:teuthology.orchestra.run.smithi026:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:49:13.490 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:13.547 INFO:teuthology.orchestra.run.smithi026:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2020-04-28T12:49:13.624 INFO:teuthology.orchestra.run.smithi026.stderr:Generating a RSA private key 2020-04-28T12:49:13.728 INFO:teuthology.orchestra.run.smithi026.stderr:......................++++ 2020-04-28T12:49:14.177 INFO:teuthology.orchestra.run.smithi026.stderr:....................................................................................................++++ 2020-04-28T12:49:14.178 INFO:teuthology.orchestra.run.smithi026.stderr:writing new private key to '/home/ubuntu/cephtest/ca/root.key' 2020-04-28T12:49:14.178 INFO:teuthology.orchestra.run.smithi026.stderr:----- 2020-04-28T12:49:14.186 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:14.240 INFO:teuthology.orchestra.run.smithi026:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2020-04-28T12:49:14.320 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:14.374 INFO:teuthology.orchestra.run.smithi026:> sudo update-ca-trust 2020-04-28T12:49:14.814 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:49:14.831 INFO:teuthology.orchestra.run.smithi107:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:49:14.888 INFO:tasks.openssl_keys:copying from ubuntu@smithi026.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt to ubuntu@smithi107.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/root.crt... 2020-04-28T12:49:14.905 DEBUG:teuthology.orchestra.remote:smithi026:/home/ubuntu/cephtest/ca/root.crt is 2KB 2020-04-28T12:49:14.972 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:49:14.987 INFO:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2020-04-28T12:49:15.072 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:49:15.087 INFO:teuthology.orchestra.run.smithi107:> sudo update-ca-trust 2020-04-28T12:49:15.483 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:49:15.497 INFO:teuthology.orchestra.run.smithi107:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:49:15.551 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:15.570 INFO:teuthology.orchestra.run.smithi026:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.1.key -out /home/ubuntu/cephtest/ca/rgw.client.1.csr -subj /CN=smithi107.front.sepia.ceph.com 2020-04-28T12:49:15.628 INFO:teuthology.orchestra.run.smithi026.stderr:Generating a RSA private key 2020-04-28T12:49:15.634 INFO:teuthology.orchestra.run.smithi026.stderr:.....+++++ 2020-04-28T12:49:15.671 INFO:teuthology.orchestra.run.smithi026.stderr:....................................+++++ 2020-04-28T12:49:15.672 INFO:teuthology.orchestra.run.smithi026.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.1.key' 2020-04-28T12:49:15.672 INFO:teuthology.orchestra.run.smithi026.stderr:----- 2020-04-28T12:49:15.673 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:15.728 INFO:teuthology.orchestra.run.smithi026:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.1.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.1.crt -days 365 -sha256 2020-04-28T12:49:15.790 INFO:teuthology.orchestra.run.smithi026.stderr:Signature ok 2020-04-28T12:49:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:subject=CN = smithi107.front.sepia.ceph.com 2020-04-28T12:49:15.791 INFO:teuthology.orchestra.run.smithi026.stderr:Getting CA Private Key 2020-04-28T12:49:15.799 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:15.854 INFO:teuthology.orchestra.run.smithi026:> rm /home/ubuntu/cephtest/ca/rgw.client.1.csr /home/ubuntu/cephtest/ca/root.srl 2020-04-28T12:49:15.910 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:15.965 INFO:teuthology.orchestra.run.smithi026:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.1.crt 2020-04-28T12:49:16.022 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2020-04-28T12:49:16.023 INFO:tasks.openssl_keys:copying from ubuntu@smithi026.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt to ubuntu@smithi107.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.crt... 2020-04-28T12:49:16.081 DEBUG:teuthology.orchestra.remote:smithi026:/home/ubuntu/cephtest/ca/rgw.client.1.crt is 1KB 2020-04-28T12:49:16.149 INFO:tasks.openssl_keys:copying from ubuntu@smithi026.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key to ubuntu@smithi107.front.sepia.ceph.com:/home/ubuntu/cephtest/ca/rgw.client.1.key... 2020-04-28T12:49:16.197 DEBUG:teuthology.orchestra.remote:smithi026:/home/ubuntu/cephtest/ca/rgw.client.1.key is 2KB 2020-04-28T12:49:16.292 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:16.312 INFO:teuthology.orchestra.run.smithi026:> rm /home/ubuntu/cephtest/ca/rgw.client.1.crt /home/ubuntu/cephtest/ca/rgw.client.1.key 2020-04-28T12:49:16.361 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:49:16.375 INFO:teuthology.orchestra.run.smithi107:> openssl verify /home/ubuntu/cephtest/ca/rgw.client.1.crt 2020-04-28T12:49:16.453 INFO:teuthology.orchestra.run.smithi107.stdout:/home/ubuntu/cephtest/ca/rgw.client.1.crt: OK 2020-04-28T12:49:16.454 INFO:teuthology.orchestra.run.smithi107:> true 2020-04-28T12:49:16.507 INFO:teuthology.orchestra.run.smithi107:> cat /home/ubuntu/cephtest/ca/rgw.client.1.key >> /home/ubuntu/cephtest/ca/rgw.client.1.crt 2020-04-28T12:49:16.561 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:16.577 INFO:teuthology.orchestra.run.smithi026:> mkdir -p /home/ubuntu/cephtest/ca 2020-04-28T12:49:16.640 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:16.694 INFO:teuthology.orchestra.run.smithi026:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi026.front.sepia.ceph.com 2020-04-28T12:49:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:Generating a RSA private key 2020-04-28T12:49:16.786 INFO:teuthology.orchestra.run.smithi026.stderr:..................................+++++ 2020-04-28T12:49:16.908 INFO:teuthology.orchestra.run.smithi026.stderr:.........................................................................................................................+++++ 2020-04-28T12:49:16.908 INFO:teuthology.orchestra.run.smithi026.stderr:writing new private key to '/home/ubuntu/cephtest/ca/rgw.client.0.key' 2020-04-28T12:49:16.908 INFO:teuthology.orchestra.run.smithi026.stderr:----- 2020-04-28T12:49:16.910 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:16.974 INFO:teuthology.orchestra.run.smithi026:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 2020-04-28T12:49:17.035 INFO:teuthology.orchestra.run.smithi026.stderr:Signature ok 2020-04-28T12:49:17.035 INFO:teuthology.orchestra.run.smithi026.stderr:subject=CN = smithi026.front.sepia.ceph.com 2020-04-28T12:49:17.036 INFO:teuthology.orchestra.run.smithi026.stderr:Getting CA Private Key 2020-04-28T12:49:17.042 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:17.096 INFO:teuthology.orchestra.run.smithi026:> rm /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl 2020-04-28T12:49:17.151 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:17.204 INFO:teuthology.orchestra.run.smithi026:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2020-04-28T12:49:17.263 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2020-04-28T12:49:17.264 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:17.317 INFO:teuthology.orchestra.run.smithi026:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2020-04-28T12:49:17.372 INFO:teuthology.run_tasks:Running task rgw... 2020-04-28T12:49:17.400 DEBUG:tasks.rgw:config is {'client.1': {'ssl certificate': 'rgw.client.1'}, 'client.0': {'ssl certificate': 'rgw.client.0'}} 2020-04-28T12:49:17.400 DEBUG:tasks.rgw:client list is ['client.0'] 2020-04-28T12:49:17.400 INFO:tasks.rgw:Creating data pools 2020-04-28T12:49:17.400 DEBUG:tasks.rgw:Obtaining remote for client client.0 2020-04-28T12:49:17.401 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:17.426 INFO:teuthology.orchestra.run.smithi026:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=2 m=1 --cluster ceph 2020-04-28T12:49:18.534 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:18.550 INFO:teuthology.orchestra.run.smithi026:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2020-04-28T12:49:20.549 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'default.rgw.buckets.data' created 2020-04-28T12:49:20.567 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:20.583 INFO:teuthology.orchestra.run.smithi026:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2020-04-28T12:49:21.585 INFO:teuthology.orchestra.run.smithi026.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2020-04-28T12:49:21.598 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:21.613 INFO:teuthology.orchestra.run.smithi026:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2020-04-28T12:49:22.557 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'default.rgw.buckets.index' created 2020-04-28T12:49:22.569 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:22.584 INFO:teuthology.orchestra.run.smithi026:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2020-04-28T12:49:23.572 INFO:teuthology.orchestra.run.smithi026.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2020-04-28T12:49:23.588 DEBUG:tasks.rgw:Pools created 2020-04-28T12:49:23.588 INFO:tasks.rgw:Configuring compression type = random 2020-04-28T12:49:23.588 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:49:23.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:49:23.588 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:23.603 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:49:23.687 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:23.682+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.574 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.569+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.574 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.569+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.575 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.571+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.575 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.571+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.576 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.572+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.576 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.572+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.577 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.573+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.594 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.590+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.590+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.590+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.590+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.595 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.590+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.591+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.591+0000 7fa3f1ba0180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:49:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.591+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.596 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.591+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.591+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.592+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.592+0000 7fa3f1ba0180 10 Creating default zonegroup 2020-04-28T12:49:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.592+0000 7fa3f1ba0180 20 get_system_obj_state: rctx=0x7ffcecc28d30 obj=:.pools.avail state=0x559be08b3170 s->prefetch_data=0 2020-04-28T12:49:25.597 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.592+0000 7fa3f1ba0180 10 couldn't find old data placement pools config, setting up new ones for the zone 2020-04-28T12:49:25.598 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.594+0000 7fa3e038a700 0 -- 172.21.15.26:0/2668717257 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa3d40094e0 msgr2=0x7fa3d4009920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:49:25.605 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.601+0000 7fa3dfb89700 0 -- 172.21.15.26:0/2668717257 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa3d0011a40 msgr2=0x7fa3d0016230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:49:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.605+0000 7fa3f1ba0180 10 WARNING: store->list_zones() returned r=-2 2020-04-28T12:49:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.605+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.610 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.605+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.613 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.609+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.614 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.609+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.614 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.609+0000 7fa3f1ba0180 10 could not read realm id: (2) No such file or directory 2020-04-28T12:49:25.614 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.609+0000 7fa3f1ba0180 10 WARNING: failed to set zone as default, r=-22 2020-04-28T12:49:25.615 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.609+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.615 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.610+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.618 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.613+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.621 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.616+0000 7fa3f1ba0180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:49:25.621 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.617+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.617+0000 7fa3f1ba0180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:49:25.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.617+0000 7fa3f1ba0180 20 zonegroup default 2020-04-28T12:49:25.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.617+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.618+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:25.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.618+0000 7fa3f1ba0180 10 Cannot find current period zone using local zone 2020-04-28T12:49:25.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.618+0000 7fa3f1ba0180 10 Using default name default 2020-04-28T12:49:25.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.618+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.618+0000 7fa3f1ba0180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:25.624 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.618+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:25.624 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.619+0000 7fa3f1ba0180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:49:25.624 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.619+0000 7fa3f1ba0180 20 zone default found 2020-04-28T12:49:25.625 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:25.619+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:27.583+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:27.583+0000 7fa3f1ba0180 20 rados->read ofs=0 len=0 2020-04-28T12:49:27.593 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:27.589+0000 7fa3f1ba0180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:27.593 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:27.589+0000 7fa3f1ba0180 20 started sync module instance, tier type = 2020-04-28T12:49:27.593 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:27.589+0000 7fa3f1ba0180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:49:29.621 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.617+0000 7fa3f1ba0180 20 add_watcher() i=0 2020-04-28T12:49:29.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.617+0000 7fa3f1ba0180 20 add_watcher() i=1 2020-04-28T12:49:29.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.617+0000 7fa3f1ba0180 20 add_watcher() i=2 2020-04-28T12:49:29.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.617+0000 7fa3f1ba0180 20 add_watcher() i=3 2020-04-28T12:49:29.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.617+0000 7fa3f1ba0180 20 add_watcher() i=4 2020-04-28T12:49:29.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.617+0000 7fa3f1ba0180 20 add_watcher() i=5 2020-04-28T12:49:29.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.617+0000 7fa3f1ba0180 20 add_watcher() i=6 2020-04-28T12:49:29.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.618+0000 7fa3f1ba0180 20 add_watcher() i=7 2020-04-28T12:49:29.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.618+0000 7fa3f1ba0180 2 all 8 watchers are set, enabling cache 2020-04-28T12:49:29.623 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.618+0000 7fa3f1ba0180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:49:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.618+0000 7fa3f1ba0180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:49:29.624 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:29.618+0000 7fa32bfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:49:33.597 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.593+0000 7fa3f1ba0180 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2020-04-28T12:49:33.678 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.673+0000 7fa31a7fc700 20 reqs_thread_entry: start 2020-04-28T12:49:33.678 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.673+0000 7fa30bfff700 20 reqs_thread_entry: start 2020-04-28T12:49:33.678 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.673+0000 7fa3f1ba0180 20 init_complete bucket index max shards: 1999 2020-04-28T12:49:33.679 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.674+0000 7fa30a7fc700 20 reqs_thread_entry: start 2020-04-28T12:49:33.693 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.689+0000 7fa32bfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:49:33.694 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.690+0000 7fa3f1ba0180 20 remove_watcher() i=0 2020-04-28T12:49:33.695 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.690+0000 7fa3f1ba0180 2 removed watcher, disabling cache 2020-04-28T12:49:33.696 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.692+0000 7fa3f1ba0180 20 remove_watcher() i=1 2020-04-28T12:49:33.698 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.693+0000 7fa3f1ba0180 20 remove_watcher() i=2 2020-04-28T12:49:33.699 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.695+0000 7fa3f1ba0180 20 remove_watcher() i=3 2020-04-28T12:49:33.701 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.696+0000 7fa3f1ba0180 20 remove_watcher() i=4 2020-04-28T12:49:33.702 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.698+0000 7fa3f1ba0180 20 remove_watcher() i=5 2020-04-28T12:49:33.703 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.699+0000 7fa3f1ba0180 20 remove_watcher() i=6 2020-04-28T12:49:33.705 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.700+0000 7fa3f1ba0180 20 remove_watcher() i=7 2020-04-28T12:49:33.709 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2020-04-28T12:49:33.709 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:49:33.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:49:33.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2020-04-28T12:49:33.710 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:33.764 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2020-04-28T12:49:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.848+0000 7f0302798180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:49:33.853 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.848+0000 7f0302798180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:49:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.852+0000 7f0233fff700 20 reqs_thread_entry: start 2020-04-28T12:49:33.856 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.852+0000 7f0302798180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.853+0000 7f0302798180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:33.857 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.853+0000 7f0302798180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.854+0000 7f0302798180 20 rados_obj.operate() r=0 bl.length=805 2020-04-28T12:49:33.858 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.854+0000 7f0302798180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.854+0000 7f0302798180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.854+0000 7f0302798180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.855+0000 7f0302798180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:33.859 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.855+0000 7f0302798180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.860 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.856+0000 7f0302798180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:49:33.866 INFO:teuthology.orchestra.run.smithi026.stdout:{"id":"5e5c3d59-d3fa-462a-b634-39ba26dcbd1e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:49:33.866 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'5e5c3d59-d3fa-462a-b634-39ba26dcbd1e', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:49:33.866 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2020-04-28T12:49:33.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2020-04-28T12:49:33.867 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:33.880 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2020-04-28T12:49:33.967 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.963+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.969 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.964+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.969 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.964+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.969 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.965+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.970 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.965+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.970 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.965+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.970 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.965+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.971 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.966+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:33.986 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.982+0000 7f5de72cc180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:49:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.982+0000 7f5de72cc180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:49:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.982+0000 7f5de72cc180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:49:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.982+0000 7f5de72cc180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:49:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.982+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.982+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:33.987 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.982+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.989 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.983+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:49:33.989 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.983+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.989 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.983+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:33.989 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.983+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.991 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.983+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:49:33.991 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.983+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.991 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.984+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.991 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.984+0000 7f5de72cc180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:49:33.991 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.984+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.991 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.984+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.991 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.984+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.992 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:33.992 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.993 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:49:33.993 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 20 zonegroup default 2020-04-28T12:49:33.993 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.994 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.994 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 10 Cannot find current period zone using local zone 2020-04-28T12:49:33.994 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.985+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.994 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.986+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.994 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.986+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.994 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.986+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:33.995 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.986+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.995 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:49:33.995 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 zone default found 2020-04-28T12:49:33.995 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.995 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.995 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 rados->read ofs=0 len=0 2020-04-28T12:49:33.995 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:33.996 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 started sync module instance, tier type = 2020-04-28T12:49:33.996 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.987+0000 7f5de72cc180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:49:33.996 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.989+0000 7f5dd5ab6700 0 -- 172.21.15.26:0/2984308271 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7f5dc80038c0 msgr2=0x7f5dc80020b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:49:34.003 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.999+0000 7f5de72cc180 20 add_watcher() i=0 2020-04-28T12:49:34.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.999+0000 7f5de72cc180 20 add_watcher() i=1 2020-04-28T12:49:34.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.999+0000 7f5de72cc180 20 add_watcher() i=2 2020-04-28T12:49:34.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.999+0000 7f5de72cc180 20 add_watcher() i=3 2020-04-28T12:49:34.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.999+0000 7f5de72cc180 20 add_watcher() i=4 2020-04-28T12:49:34.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.999+0000 7f5de72cc180 20 add_watcher() i=5 2020-04-28T12:49:34.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:33.999+0000 7f5de72cc180 20 add_watcher() i=6 2020-04-28T12:49:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.000+0000 7f5de72cc180 20 add_watcher() i=7 2020-04-28T12:49:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.000+0000 7f5de72cc180 2 all 8 watchers are set, enabling cache 2020-04-28T12:49:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.000+0000 7f5de72cc180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:49:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.000+0000 7f5de72cc180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:49:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.000+0000 7f5da5fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:49:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.001+0000 7f5dd4ab4700 0 -- 172.21.15.26:0/3282762757 >> v1:172.21.15.26:6789/0 conn(0x55a0cff55df0 legacy=0x55a0cff581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:49:34.055 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.050+0000 7f5d17fff700 20 reqs_thread_entry: start 2020-04-28T12:49:34.056 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.050+0000 7f5d15ffb700 20 reqs_thread_entry: start 2020-04-28T12:49:34.056 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.050+0000 7f5de72cc180 20 init_complete bucket index max shards: 1999 2020-04-28T12:49:34.056 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.051+0000 7f5d03fff700 20 reqs_thread_entry: start 2020-04-28T12:49:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.064+0000 7f5da5fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:49:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.065+0000 7f5de72cc180 20 remove_watcher() i=0 2020-04-28T12:49:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.065+0000 7f5de72cc180 2 removed watcher, disabling cache 2020-04-28T12:49:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.067+0000 7f5de72cc180 20 remove_watcher() i=1 2020-04-28T12:49:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.068+0000 7f5de72cc180 20 remove_watcher() i=2 2020-04-28T12:49:34.073 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.069+0000 7f5de72cc180 20 remove_watcher() i=3 2020-04-28T12:49:34.075 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.071+0000 7f5de72cc180 20 remove_watcher() i=4 2020-04-28T12:49:34.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.072+0000 7f5de72cc180 20 remove_watcher() i=5 2020-04-28T12:49:34.077 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.073+0000 7f5de72cc180 20 remove_watcher() i=6 2020-04-28T12:49:34.078 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.074+0000 7f5de72cc180 20 remove_watcher() i=7 2020-04-28T12:49:34.082 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2020-04-28T12:49:34.083 DEBUG:tasks.util.rgw: json result: [] 2020-04-28T12:49:34.083 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2020-04-28T12:49:34.083 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:49:34.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2020-04-28T12:49:34.083 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:34.136 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2020-04-28T12:49:34.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.219+0000 7fe75ef62180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:49:34.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.219+0000 7fe75ef62180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:49:34.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.222+0000 7fe6acff9700 20 reqs_thread_entry: start 2020-04-28T12:49:34.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.222+0000 7fe75ef62180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.223+0000 7fe75ef62180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:34.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.223+0000 7fe75ef62180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.224+0000 7fe75ef62180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:34.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.224+0000 7fe75ef62180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.225+0000 7fe75ef62180 20 rados_obj.operate() r=0 bl.length=358 2020-04-28T12:49:34.230 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.225+0000 7fe75ef62180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.231 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.226+0000 7fe75ef62180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:49:34.235 INFO:teuthology.orchestra.run.smithi026.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2020-04-28T12:49:34.236 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:49:34.236 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:49:34.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2020-04-28T12:49:34.236 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:34.250 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2020-04-28T12:49:34.339 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.335+0000 7f4392872180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:49:34.340 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.335+0000 7f4392872180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:49:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.338+0000 7f4308ff9700 20 reqs_thread_entry: start 2020-04-28T12:49:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.338+0000 7f4392872180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.339+0000 7f4392872180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.339+0000 7f4392872180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.340+0000 7f4392872180 20 rados_obj.operate() r=0 bl.length=821 2020-04-28T12:49:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.340+0000 7f4392872180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.341+0000 7f4392872180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.341+0000 7f4392872180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.341+0000 7f4392872180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.341+0000 7f4392872180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.345+0000 7f4392872180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:49:34.355 INFO:teuthology.orchestra.run.smithi026.stdout:{"id":"5e5c3d59-d3fa-462a-b634-39ba26dcbd1e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:49:34.355 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'5e5c3d59-d3fa-462a-b634-39ba26dcbd1e', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:49:34.355 INFO:tasks.rgw:Configuring storage class type = FROZEN 2020-04-28T12:49:34.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:49:34.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2020-04-28T12:49:34.356 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:34.369 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2020-04-28T12:49:34.458 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.453+0000 7f21d8159180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:49:34.458 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.453+0000 7f21d8159180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:49:34.461 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.456+0000 7f212e7fc700 20 reqs_thread_entry: start 2020-04-28T12:49:34.461 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.456+0000 7f21d8159180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.463 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.457+0000 7f21d8159180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:34.463 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.457+0000 7f21d8159180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.463 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.458+0000 7f21d8159180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:34.463 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.458+0000 7f21d8159180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.464 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.459+0000 7f21d8159180 20 rados_obj.operate() r=0 bl.length=382 2020-04-28T12:49:34.464 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.459+0000 7f21d8159180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.465 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.460+0000 7f21d8159180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:49:34.470 INFO:teuthology.orchestra.run.smithi026.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2020-04-28T12:49:34.470 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2020-04-28T12:49:34.470 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:49:34.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2020-04-28T12:49:34.471 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:34.484 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2020-04-28T12:49:34.573 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.569+0000 7f0dc7931180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:49:34.573 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.569+0000 7f0dc7931180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:49:34.576 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.572+0000 7f0cfdffb700 20 reqs_thread_entry: start 2020-04-28T12:49:34.576 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.572+0000 7f0dc7931180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.577 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.573+0000 7f0dc7931180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:34.577 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.573+0000 7f0dc7931180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.579 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.574+0000 7f0dc7931180 20 rados_obj.operate() r=0 bl.length=888 2020-04-28T12:49:34.579 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.574+0000 7f0dc7931180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.579 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.575+0000 7f0dc7931180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:49:34.580 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.575+0000 7f0dc7931180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.580 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.575+0000 7f0dc7931180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:49:34.580 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.575+0000 7f0dc7931180 20 rados->read ofs=0 len=0 2020-04-28T12:49:34.583 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:49:34.579+0000 7f0dc7931180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:49:34.589 INFO:teuthology.orchestra.run.smithi026.stdout:{"id":"5e5c3d59-d3fa-462a-b634-39ba26dcbd1e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2020-04-28T12:49:34.589 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'5e5c3d59-d3fa-462a-b634-39ba26dcbd1e', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2020-04-28T12:49:34.589 INFO:tasks.rgw:Starting rgw... 2020-04-28T12:49:34.590 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2020-04-28T12:49:34.590 INFO:tasks.rgw:Using beast as radosgw frontend 2020-04-28T12:49:34.590 INFO:tasks.rgw.client.0:Restarting daemon 2020-04-28T12:49:34.590 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:34.604 INFO:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2020-04-28T12:49:34.646 INFO:tasks.rgw.client.0:Started 2020-04-28T12:49:34.647 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi026.front.sepia.ceph.com:443/ 2020-04-28T12:49:34.647 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:34.661 INFO:teuthology.orchestra.run.smithi026:> curl https://smithi026.front.sepia.ceph.com:443/ 2020-04-28T12:49:34.737 INFO:teuthology.orchestra.run.smithi026.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-04-28T12:49:34.738 INFO:teuthology.orchestra.run.smithi026.stderr: Dload Upload Total Spent Left Speed 2020-04-28T12:49:34.738 INFO:teuthology.orchestra.run.smithi026.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to smithi026.front.sepia.ceph.com port 443: Connection refused 2020-04-28T12:49:34.738 DEBUG:teuthology.orchestra.run:got remote process result: 7 2020-04-28T12:49:34.830 INFO:tasks.rgw.client.0.smithi026.stdout:2020-04-28T12:49:34.826+0000 7f3ead2f9280 -1 ssl_private_key was not found: rgw/cert//default.key 2020-04-28T12:49:35.739 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:35.755 INFO:teuthology.orchestra.run.smithi026:> curl https://smithi026.front.sepia.ceph.com:443/ 2020-04-28T12:49:35.814 INFO:teuthology.orchestra.run.smithi026.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2020-04-28T12:49:35.814 INFO:teuthology.orchestra.run.smithi026.stderr: Dload Upload Total Spent Left Speed 2020-04-28T12:49:35.868 INFO:teuthology.orchestra.run.smithi026.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 3890 0 --:--:-- --:--:-- --:--:-- 3962 2020-04-28T12:49:35.869 INFO:teuthology.orchestra.run.smithi026.stdout:anonymous 2020-04-28T12:49:35.870 INFO:teuthology.run_tasks:Running task workunit... 2020-04-28T12:49:35.886 INFO:tasks.workunit:Pulling workunits from ref a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:49:35.886 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-04-28T12:49:35.886 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:35.924 INFO:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:49:35.981 INFO:teuthology.orchestra.run.smithi026.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-04-28T12:49:35.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-04-28T12:49:35.982 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:36.036 INFO:teuthology.orchestra.run.smithi026:> mkdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:49:36.094 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2020-04-28T12:49:36.094 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:36.149 INFO:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2020-04-28T12:49:36.205 INFO:tasks.workunit:timeout=3h 2020-04-28T12:49:36.206 INFO:tasks.workunit:cleanup=True 2020-04-28T12:49:36.206 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:49:36.267 INFO:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c125c7d78f5cd973863993d258cd717ade4c99 2020-04-28T12:49:36.389 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-04-28T12:51:02.288 INFO:tasks.workunit.client.0.smithi026.stderr:Note: checking out 'a8c125c7d78f5cd973863993d258cd717ade4c99'. 2020-04-28T12:51:02.288 INFO:tasks.workunit.client.0.smithi026.stderr: 2020-04-28T12:51:02.288 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-04-28T12:51:02.289 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2020-04-28T12:51:02.289 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by performing another checkout. 2020-04-28T12:51:02.289 INFO:tasks.workunit.client.0.smithi026.stderr: 2020-04-28T12:51:02.289 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2020-04-28T12:51:02.289 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-04-28T12:51:02.289 INFO:tasks.workunit.client.0.smithi026.stderr: 2020-04-28T12:51:02.289 INFO:tasks.workunit.client.0.smithi026.stderr: git checkout -b 2020-04-28T12:51:02.290 INFO:tasks.workunit.client.0.smithi026.stderr: 2020-04-28T12:51:02.290 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at a8c125c7d7 Merge pull request #34750 from yuriw/wip-yuriw-distro-octupus 2020-04-28T12:51:02.291 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:51:02.310 INFO:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-04-28T12:51:02.378 INFO:tasks.workunit.client.0.smithi026.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-04-28T12:51:02.380 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:51:02.380 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-04-28T12:51:03.331 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-04-28T12:51:03.391 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-04-28T12:51:03.427 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-04-28T12:51:03.428 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:51:03.429 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-04-28T12:51:03.467 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-04-28T12:51:03.527 DEBUG:teuthology.orchestra.remote:smithi026:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-04-28T12:51:03.578 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2020-04-28T12:51:03.579 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2020-04-28T12:51:03.579 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:51:03.593 INFO:teuthology.orchestra.run.smithi026:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2020-04-28T12:51:03.661 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2020-04-28T12:51:03.661 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 11 tests from 1 test suite. 2020-04-28T12:51:03.661 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2020-04-28T12:51:03.661 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 11 tests from ClsLock 2020-04-28T12:51:03.661 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestMultiLocking 2020-04-28T12:51:04.811 INFO:tasks.workunit.client.0.smithi026.stdout:lock: mylock 2020-04-28T12:51:04.811 INFO:tasks.workunit.client.0.smithi026.stdout: lock_type: exclusive 2020-04-28T12:51:04.812 INFO:tasks.workunit.client.0.smithi026.stdout: tag: 2020-04-28T12:51:04.812 INFO:tasks.workunit.client.0.smithi026.stdout: lockers: 2020-04-28T12:51:04.812 INFO:tasks.workunit.client.0.smithi026.stdout: client.4394 expiration=2020-04-28T12:53:04.801952+0000 addr=v1:172.21.15.26:0/2944358 cookie= 2020-04-28T12:51:04.817 INFO:tasks.workunit.client.0.smithi026.stdout:lock: mylock 2020-04-28T12:51:04.818 INFO:tasks.workunit.client.0.smithi026.stdout: lock_type: shared 2020-04-28T12:51:04.818 INFO:tasks.workunit.client.0.smithi026.stdout: tag: 2020-04-28T12:51:04.818 INFO:tasks.workunit.client.0.smithi026.stdout: lockers: 2020-04-28T12:51:04.818 INFO:tasks.workunit.client.0.smithi026.stdout: client.4394 expiration=2020-04-28T12:53:04.812131+0000 addr=v1:172.21.15.26:0/2944358 cookie= 2020-04-28T12:51:04.818 INFO:tasks.workunit.client.0.smithi026.stdout: client.4641 expiration=0.000000 addr=v1:172.21.15.26:0/1027785789 cookie= 2020-04-28T12:51:04.820 INFO:tasks.workunit.client.0.smithi026.stdout:lock: mylock 2020-04-28T12:51:04.820 INFO:tasks.workunit.client.0.smithi026.stdout: lock_type: shared 2020-04-28T12:51:04.820 INFO:tasks.workunit.client.0.smithi026.stdout: tag: 2020-04-28T12:51:04.820 INFO:tasks.workunit.client.0.smithi026.stdout: lockers: 2020-04-28T12:51:04.820 INFO:tasks.workunit.client.0.smithi026.stdout: client.4641 expiration=0.000000 addr=v1:172.21.15.26:0/1027785789 cookie= 2020-04-28T12:51:05.783 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestMultiLocking (2123 ms) 2020-04-28T12:51:05.783 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestMeta 2020-04-28T12:51:07.834 INFO:tasks.workunit.client.0.smithi026.stdout:lock: mylock 2020-04-28T12:51:07.834 INFO:tasks.workunit.client.0.smithi026.stdout: lock_type: shared 2020-04-28T12:51:07.834 INFO:tasks.workunit.client.0.smithi026.stdout: tag: 2020-04-28T12:51:07.834 INFO:tasks.workunit.client.0.smithi026.stdout: lockers: 2020-04-28T12:51:07.834 INFO:tasks.workunit.client.0.smithi026.stdout: client.4662 expiration=0.000000 addr=v1:172.21.15.26:0/3403145634 cookie= 2020-04-28T12:51:07.837 INFO:tasks.workunit.client.0.smithi026.stdout:lock: mylock 2020-04-28T12:51:07.837 INFO:tasks.workunit.client.0.smithi026.stdout: lock_type: exclusive 2020-04-28T12:51:07.837 INFO:tasks.workunit.client.0.smithi026.stdout: tag: new_tag 2020-04-28T12:51:07.837 INFO:tasks.workunit.client.0.smithi026.stdout: lockers: 2020-04-28T12:51:07.838 INFO:tasks.workunit.client.0.smithi026.stdout: client.4650 expiration=0.000000 addr=v1:172.21.15.26:0/2380231535 cookie= 2020-04-28T12:51:08.795 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestMeta (3012 ms) 2020-04-28T12:51:08.796 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestCookie 2020-04-28T12:51:10.838 INFO:tasks.workunit.client.0.smithi026.stdout:lock: mylock 2020-04-28T12:51:10.838 INFO:tasks.workunit.client.0.smithi026.stdout: lock_type: exclusive 2020-04-28T12:51:10.838 INFO:tasks.workunit.client.0.smithi026.stdout: tag: 2020-04-28T12:51:10.839 INFO:tasks.workunit.client.0.smithi026.stdout: lockers: 2020-04-28T12:51:10.841 INFO:tasks.workunit.client.0.smithi026.stdout:lock: mylock 2020-04-28T12:51:10.841 INFO:tasks.workunit.client.0.smithi026.stdout: lock_type: shared 2020-04-28T12:51:10.842 INFO:tasks.workunit.client.0.smithi026.stdout: tag: 2020-04-28T12:51:10.842 INFO:tasks.workunit.client.0.smithi026.stdout: lockers: 2020-04-28T12:51:10.842 INFO:tasks.workunit.client.0.smithi026.stdout: client.4668 expiration=0.000000 addr=v1:172.21.15.26:0/483097219 cookie= 2020-04-28T12:51:10.842 INFO:tasks.workunit.client.0.smithi026.stdout: client.4668 expiration=0.000000 addr=v1:172.21.15.26:0/483097219 cookie=new cookie 2020-04-28T12:51:11.823 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestCookie (3027 ms) 2020-04-28T12:51:11.823 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestMultipleLocks 2020-04-28T12:51:14.834 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestMultipleLocks (3011 ms) 2020-04-28T12:51:14.834 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestLockDuration 2020-04-28T12:51:22.528 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestLockDuration (7694 ms) 2020-04-28T12:51:22.528 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestAssertLocked 2020-04-28T12:51:25.549 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestAssertLocked (3021 ms) 2020-04-28T12:51:25.549 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestSetCookie 2020-04-28T12:51:28.574 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestSetCookie (3025 ms) 2020-04-28T12:51:28.574 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestRenew 2020-04-28T12:51:49.618 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestRenew (21044 ms) 2020-04-28T12:51:49.618 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2020-04-28T12:51:56.667 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7049 ms) 2020-04-28T12:51:56.667 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2020-04-28T12:52:04.700 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8033 ms) 2020-04-28T12:52:04.700 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2020-04-28T12:52:12.737 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8035 ms) 2020-04-28T12:52:12.737 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 11 tests from ClsLock (69074 ms total) 2020-04-28T12:52:12.737 INFO:tasks.workunit.client.0.smithi026.stdout: 2020-04-28T12:52:12.737 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2020-04-28T12:52:12.737 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 11 tests from 1 test suite ran. (69074 ms total) 2020-04-28T12:52:12.737 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 11 tests. 2020-04-28T12:52:12.738 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:52:12.796 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:52:12.797 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:52:12.907 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2020-04-28T12:52:12.908 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2020-04-28T12:52:12.908 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:52:12.937 INFO:teuthology.orchestra.run.smithi026:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2020-04-28T12:52:13.026 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2020-04-28T12:52:13.026 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:52:13.026 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2020-04-28T12:52:13.027 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from cls_log 2020-04-28T12:52:13.027 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_log.test_log_add_same_time 2020-04-28T12:52:15.748 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_log.test_log_add_same_time (2722 ms) 2020-04-28T12:52:15.748 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_log.test_log_add_different_time 2020-04-28T12:52:18.767 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_log.test_log_add_different_time (3014 ms) 2020-04-28T12:52:18.767 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_log.trim_by_time 2020-04-28T12:52:21.783 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_log.trim_by_time (3021 ms) 2020-04-28T12:52:21.783 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_log.trim_by_marker 2020-04-28T12:52:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_log.trim_by_marker (3035 ms) 2020-04-28T12:52:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from cls_log (11792 ms total) 2020-04-28T12:52:24.818 INFO:tasks.workunit.client.0.smithi026.stdout: 2020-04-28T12:52:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2020-04-28T12:52:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 4 tests from 1 test suite ran. (11792 ms total) 2020-04-28T12:52:24.818 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 4 tests. 2020-04-28T12:52:24.819 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:52:24.835 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:52:24.835 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:52:24.943 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2020-04-28T12:52:24.944 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2020-04-28T12:52:24.945 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:52:24.968 INFO:teuthology.orchestra.run.smithi026:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2020-04-28T12:52:25.039 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2020-04-28T12:52:25.039 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:52:25.039 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2020-04-28T12:52:25.040 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from cls_rgw 2020-04-28T12:52:25.040 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.test_implicit 2020-04-28T12:52:27.837 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.test_implicit (2798 ms) 2020-04-28T12:52:27.837 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2020-04-28T12:52:30.862 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3025 ms) 2020-04-28T12:52:30.862 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.test_put_snap 2020-04-28T12:52:37.023 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T12:52:37.017+0000 7f0fced7a700 -1 osd.7 pg_epoch: 96 pg[26.6( v 95'4 (0'0,95'4] local-lis/les=92/93 n=2 ec=92/92 lis/c=92/92 les/c/f=93/93/0 sis=92) [7,6] r=0 lpr=92 crt=94'3 lcod 94'3 mlcod 94'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2020-04-28T12:52:38.908 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.test_put_snap (8046 ms) 2020-04-28T12:52:38.908 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.test_explicit 2020-04-28T12:52:41.938 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.test_explicit (3030 ms) 2020-04-28T12:52:41.938 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.set 2020-04-28T12:52:44.975 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.set (3036 ms) 2020-04-28T12:52:44.975 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from cls_rgw (19935 ms total) 2020-04-28T12:52:44.975 INFO:tasks.workunit.client.0.smithi026.stdout: 2020-04-28T12:52:44.976 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2020-04-28T12:52:44.976 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 5 tests from 1 test suite ran. (19935 ms total) 2020-04-28T12:52:44.976 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 5 tests. 2020-04-28T12:52:44.977 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:52:45.034 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:52:45.034 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:52:45.118 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2020-04-28T12:52:45.118 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2020-04-28T12:52:45.118 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:52:45.173 INFO:teuthology.orchestra.run.smithi026:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2020-04-28T12:52:45.244 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2020-04-28T12:52:45.244 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 14 tests from 1 test suite. 2020-04-28T12:52:45.245 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2020-04-28T12:52:45.245 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 14 tests from cls_rgw 2020-04-28T12:52:46.977 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.index_basic 2020-04-28T12:52:47.037 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.index_basic (61 ms) 2020-04-28T12:52:47.038 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2020-04-28T12:52:47.080 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (42 ms) 2020-04-28T12:52:47.080 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.index_remove_object 2020-04-28T12:52:47.135 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.index_remove_object (56 ms) 2020-04-28T12:52:47.136 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.index_suggest 2020-04-28T12:52:48.850 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.index_suggest (1714 ms) 2020-04-28T12:52:48.850 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.index_list 2020-04-28T12:52:48.879 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.index_list (30 ms) 2020-04-28T12:52:48.880 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.index_list_delimited 2020-04-28T12:53:19.859 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.index_list_delimited (30979 ms) 2020-04-28T12:53:19.859 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.bi_list 2020-04-28T12:53:19.974 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.bi_list (116 ms) 2020-04-28T12:53:19.975 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.gc_set 2020-04-28T12:53:20.196 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.gc_set (221 ms) 2020-04-28T12:53:20.196 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.gc_list 2020-04-28T12:53:20.214 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.gc_list (18 ms) 2020-04-28T12:53:20.214 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.gc_defer 2020-04-28T12:53:27.610 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.gc_defer (7396 ms) 2020-04-28T12:53:27.611 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.usage_basic 2020-04-28T12:53:27.707 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.usage_basic (97 ms) 2020-04-28T12:53:27.707 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2020-04-28T12:53:27.709 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2020-04-28T12:53:27.709 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.usage_clear 2020-04-28T12:53:27.845 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.usage_clear (136 ms) 2020-04-28T12:53:27.845 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] cls_rgw.bi_log_trim 2020-04-28T12:53:27.920 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] cls_rgw.bi_log_trim (74 ms) 2020-04-28T12:53:28.629 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 14 tests from cls_rgw (40943 ms total) 2020-04-28T12:53:28.629 INFO:tasks.workunit.client.0.smithi026.stdout: 2020-04-28T12:53:28.629 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2020-04-28T12:53:28.629 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 14 tests from 1 test suite ran. (43384 ms total) 2020-04-28T12:53:28.630 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 14 tests. 2020-04-28T12:53:28.630 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:28.687 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:53:28.687 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:53:28.795 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2020-04-28T12:53:28.795 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2020-04-28T12:53:28.795 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:28.820 INFO:teuthology.orchestra.run.smithi026:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2020-04-28T12:53:28.900 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 6 tests from 1 test suite. 2020-04-28T12:53:28.900 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2020-04-28T12:53:30.637 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 6 tests from rgw_gc_log 2020-04-28T12:53:30.638 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2020-04-28T12:53:30.656 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] rgw_gc_log.init_existing_queue (19 ms) 2020-04-28T12:53:30.657 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2020-04-28T12:53:30.660 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2020-04-28T12:53:30.660 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2020-04-28T12:53:30.664 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (4 ms) 2020-04-28T12:53:30.664 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2020-04-28T12:53:30.666 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2020-04-28T12:53:30.666 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2020-04-28T12:53:30.670 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2020-04-28T12:53:30.670 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2020-04-28T12:53:30.672 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2020-04-28T12:53:30.672 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 6 tests from rgw_gc_log (35 ms total) 2020-04-28T12:53:30.672 INFO:tasks.workunit.client.0.smithi026.stdout: 2020-04-28T12:53:30.673 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2020-04-28T12:53:31.649 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 6 tests from 1 test suite ran. (2748 ms total) 2020-04-28T12:53:31.649 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 6 tests. 2020-04-28T12:53:31.651 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:31.707 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:53:31.707 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:53:31.784 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2020-04-28T12:53:31.784 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2020-04-28T12:53:31.784 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:31.836 INFO:teuthology.orchestra.run.smithi026:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2020-04-28T12:53:31.913 INFO:tasks.workunit.client.0.smithi026.stdout:Running main() from gmock_main.cc 2020-04-28T12:53:31.913 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 4 tests from 1 test suite. 2020-04-28T12:53:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2020-04-28T12:53:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from TestRGWObj 2020-04-28T12:53:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] TestRGWObj.underscore 2020-04-28T12:53:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns= i= 2020-04-28T12:53:31.914 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.915 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.915 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns= i= 2020-04-28T12:53:31.915 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.915 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.915 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns= i= 2020-04-28T12:53:31.915 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:31.915 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:31.916 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.916 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.916 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.916 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.916 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.916 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.916 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.917 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.917 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.917 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.917 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.917 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.917 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.917 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.918 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.918 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.918 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.918 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:31.918 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.918 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.919 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.919 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.919 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.919 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.919 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.919 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.919 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.920 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.920 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.920 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.920 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.920 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.920 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.920 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.921 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.921 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:31.921 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.921 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.921 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.921 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.921 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.922 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.922 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.922 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.922 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.922 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.922 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.922 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.923 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.923 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.923 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.923 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.923 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.924 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:31.924 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.924 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.924 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.924 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.925 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.925 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.925 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.925 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.925 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.925 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.925 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.926 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.926 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.926 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.926 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.926 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.926 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.926 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:31.927 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.927 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.927 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns=ns i= 2020-04-28T12:53:31.927 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.927 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.927 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns=ns i= 2020-04-28T12:53:31.927 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.928 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj 2020-04-28T12:53:31.928 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns=ns i= 2020-04-28T12:53:31.928 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:31.928 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:31.928 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.928 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.928 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.929 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.929 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.929 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.929 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.929 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.929 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.929 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.930 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.930 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.930 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.930 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.930 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.930 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.930 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.931 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:31.931 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.931 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.931 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.931 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.931 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.931 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.932 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.933 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.933 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.933 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.933 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:31.933 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.933 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.933 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.934 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.934 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.934 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.934 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.934 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.934 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.934 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.935 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.935 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.935 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.935 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.935 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.935 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.935 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.936 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.937 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.938 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.938 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:31.938 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.938 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.939 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns= i=v1 2020-04-28T12:53:31.939 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.939 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.939 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns= i=v1 2020-04-28T12:53:31.939 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.939 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.939 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns= i=v1 2020-04-28T12:53:31.940 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:31.940 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:31.940 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.940 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.940 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.940 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.940 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.941 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.942 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.942 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.942 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.942 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.942 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:31.942 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.942 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.943 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.943 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.943 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.943 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.943 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.943 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.943 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.944 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.944 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.944 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.944 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.944 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.944 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.944 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.945 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.945 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:31.945 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.945 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.945 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.945 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.945 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.946 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.946 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.946 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.946 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.946 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.946 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.946 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.947 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.947 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.947 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.947 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.947 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.947 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:31.947 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.948 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.948 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.948 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.948 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.948 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.948 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.949 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.950 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.950 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.950 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:31.950 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.950 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.950 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:53:31.950 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.951 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.951 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:53:31.951 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.951 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: _obj[v1] 2020-04-28T12:53:31.951 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: _obj ns=ns i=v1 2020-04-28T12:53:31.951 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:31.951 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:31.952 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.952 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.952 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.952 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.952 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.952 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.952 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.953 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.953 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.953 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.953 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.953 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.953 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.953 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.954 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.954 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.954 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.954 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:31.954 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.954 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.954 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.955 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.955 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.955 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.955 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.955 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.955 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.956 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.956 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.956 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.956 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.956 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.956 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.956 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.957 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.958 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.958 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.958 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.958 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.958 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.958 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.958 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.959 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.959 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.959 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.959 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.959 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:31.959 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.960 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.960 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.960 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.960 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.960 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.960 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.961 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.961 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.961 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.961 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.961 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.961 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_obj", 2020-04-28T12:53:31.961 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.962 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.962 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.962 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.962 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:31.962 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2020-04-28T12:53:31.962 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] TestRGWObj.no_underscore 2020-04-28T12:53:31.963 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.963 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.963 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns= i= 2020-04-28T12:53:31.963 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.963 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.963 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns= i= 2020-04-28T12:53:31.963 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.964 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.964 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns= i= 2020-04-28T12:53:31.964 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:31.964 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:31.965 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.965 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.965 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.965 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.965 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.965 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.965 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.966 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.966 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.966 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.966 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.966 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.966 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.966 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.967 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.967 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.967 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.967 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:31.967 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.967 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.967 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.968 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.968 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.968 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.968 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.968 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.968 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.968 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.969 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.969 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.969 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.969 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.969 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.969 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.969 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.970 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:31.970 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.970 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.970 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.970 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.970 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.970 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.971 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.971 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.971 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.971 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.971 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.971 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.971 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.972 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.972 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.972 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.972 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.972 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:31.972 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.972 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.973 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.973 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.973 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.973 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.973 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.973 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.973 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.974 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.974 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.974 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.974 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.974 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.974 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.974 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.975 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.975 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:31.975 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.975 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.975 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns=ns i= 2020-04-28T12:53:31.975 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.975 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.976 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns=ns i= 2020-04-28T12:53:31.976 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.976 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj 2020-04-28T12:53:31.976 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns=ns i= 2020-04-28T12:53:31.976 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:31.976 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:31.976 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.977 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.977 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.977 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.977 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.977 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.977 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.977 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.978 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.978 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.978 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.978 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.978 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.978 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.979 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.979 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.979 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.979 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:31.979 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.979 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.980 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.980 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.980 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.980 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.980 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.980 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.980 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.981 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.981 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.981 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.981 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.981 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.981 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.981 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.982 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.982 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:31.982 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.982 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.982 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.982 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.982 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.983 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.983 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.983 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.983 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.983 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.983 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.983 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.984 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.984 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.984 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.984 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.984 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.984 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:31.984 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.985 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.985 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.985 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.985 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.985 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.985 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.985 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:31.986 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.987 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.987 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:31.987 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.987 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.987 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns= i=v1 2020-04-28T12:53:31.987 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.987 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.988 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns= i=v1 2020-04-28T12:53:31.988 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.988 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.988 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns= i=v1 2020-04-28T12:53:31.988 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:31.988 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:31.988 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.989 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.990 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.990 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.990 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.990 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.990 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.990 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.990 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.991 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.991 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:31.991 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.991 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.991 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.991 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.991 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.992 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.992 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.992 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.992 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.992 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.992 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.992 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.993 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.993 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.993 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.993 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.993 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.993 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:31.993 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.994 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.994 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.994 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.994 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.994 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.994 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.994 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.995 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.995 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.995 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.995 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.995 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.995 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:31.995 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:31.996 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:31.997 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:31.997 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:31.997 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:31.997 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:31.997 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.997 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:31.997 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:31.998 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:31.998 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:31.998 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:31.998 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.998 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:31.998 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:31.998 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.999 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.999 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:53:31.999 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.999 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.999 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:53:31.999 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:31.999 INFO:tasks.workunit.client.0.smithi026.stdout:parsed: obj[v1] 2020-04-28T12:53:32.000 INFO:tasks.workunit.client.0.smithi026.stdout:stripped: obj ns=ns i=v1 2020-04-28T12:53:32.000 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.000 INFO:tasks.workunit.client.0.smithi026.stdout: "obj1": { 2020-04-28T12:53:32.000 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.000 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.000 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.001 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.001 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.001 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.001 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.001 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.001 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.001 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.002 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.002 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.002 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:32.002 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:32.002 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.002 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.002 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "obj2": { 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.003 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.004 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.004 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.004 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.004 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.004 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.004 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:32.004 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:32.005 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.005 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.005 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.005 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3": { 2020-04-28T12:53:32.005 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.005 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.005 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.006 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.006 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.006 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.006 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.006 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.006 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.006 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.007 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.007 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.007 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:32.007 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.007 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.007 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.007 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "obj3-2": { 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.008 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.009 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.009 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.009 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.009 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.009 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.009 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "obj", 2020-04-28T12:53:32.009 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "v1", 2020-04-28T12:53:32.010 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.010 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.010 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.010 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.010 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2020-04-28T12:53:32.010 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] TestRGWObj.obj_to_raw 2020-04-28T12:53:32.010 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.011 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.011 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.011 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.011 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.011 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.011 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.011 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.012 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.012 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.012 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.012 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.012 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.012 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.012 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.013 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.013 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.013 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.013 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.013 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.013 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.013 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.014 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.014 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.014 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.014 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.014 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.014 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.014 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.015 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.015 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.015 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.015 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.015 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.015 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.015 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.016 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker_myobj", 2020-04-28T12:53:32.016 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.016 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.016 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.016 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.016 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.016 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.017 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.017 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.017 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.017 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.017 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.017 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.017 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.018 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.018 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.018 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.018 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.018 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.018 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.018 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.019 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.019 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.019 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.019 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.019 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.019 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.019 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.020 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.020 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.020 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.020 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.020 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.020 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.020 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.021 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.022 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.022 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.022 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.022 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.022 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.022 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.023 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.023 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.023 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.023 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.023 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.023 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.023 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.024 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.024 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.024 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.024 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.024 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker_myobj", 2020-04-28T12:53:32.025 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.025 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.025 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.025 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.025 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.025 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.025 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.026 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.027 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.027 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.027 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.027 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.027 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.027 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.027 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.028 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.028 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.028 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.028 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.028 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.028 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.028 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.029 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.029 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.029 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.029 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.029 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.029 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.029 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.030 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.030 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.030 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.030 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.030 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.030 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.030 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.031 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.031 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.031 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.031 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.031 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.031 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.031 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.032 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.033 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.033 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:53:32.033 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.033 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.033 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.033 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.033 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.034 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.034 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.034 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.034 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.034 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.034 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.035 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.035 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.035 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.035 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.035 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.035 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.035 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.036 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.036 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.036 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.036 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.036 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.036 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.036 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.037 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.038 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.038 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.038 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.038 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.038 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.038 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.038 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.039 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.039 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.039 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.039 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.039 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.039 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.039 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.040 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.040 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.040 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.040 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.040 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.040 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.040 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.041 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.041 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.041 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.041 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.041 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.041 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:53:32.041 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.042 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.042 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.042 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.042 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.042 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.042 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.042 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.043 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.043 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.043 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.043 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.043 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.043 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.043 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.044 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.044 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.044 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.044 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.044 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.044 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.044 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.045 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.045 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.045 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.045 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.045 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.045 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.045 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.046 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.046 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.046 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.046 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.046 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.046 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.047 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.047 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.047 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.047 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.047 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.047 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.047 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.048 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.048 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.048 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.048 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.048 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.048 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.048 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.049 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.049 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.049 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.049 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.049 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.049 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.050 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.050 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.050 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.050 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.050 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:53:32.050 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.051 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.052 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.052 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.052 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.052 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.052 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.052 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.052 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.053 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.053 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.053 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.053 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.053 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.053 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.053 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.054 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.054 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.054 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.054 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.054 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.054 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.054 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.055 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.055 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.055 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.055 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.055 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.055 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.056 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.056 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.056 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.056 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.056 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.056 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.057 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.057 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.057 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.057 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.057 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.057 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.057 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.058 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.058 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.058 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.058 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.058 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.058 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.058 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.059 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.060 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.060 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.060 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.060 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.060 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.060 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.060 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.061 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.061 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.061 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.061 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.061 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.062 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.062 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.062 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.062 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.062 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.062 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.062 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.063 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.063 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.063 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.063 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.063 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.063 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.063 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.064 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.064 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.064 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.064 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.064 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.065 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.065 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.065 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.065 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.065 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.065 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.066 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.066 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.066 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.066 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.066 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.066 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.067 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.068 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.068 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.068 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.068 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.068 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:53:32.068 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.068 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.069 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.069 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.069 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.069 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.069 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.069 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.069 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.070 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.070 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.070 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.070 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.070 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.070 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.071 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.072 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.072 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.072 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.072 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.072 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.072 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.072 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.073 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.073 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.073 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.073 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.073 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.073 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.073 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.074 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.074 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.074 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.074 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.074 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.075 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.075 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.075 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.076 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.077 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.077 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.077 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.077 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.077 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.077 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.077 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:53:32.078 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.078 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.078 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.078 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.078 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.078 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.078 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.079 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.079 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.079 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.079 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.079 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.079 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.079 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.080 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.081 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.081 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.081 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.081 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.081 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.081 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.082 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.082 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.082 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.082 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.082 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.082 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.082 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.083 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.083 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.083 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.083 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.083 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.083 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.083 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.084 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.084 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.084 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.084 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.084 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.084 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.084 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.085 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.085 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.085 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.085 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.085 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.085 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.085 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.086 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.086 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.086 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.086 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj", 2020-04-28T12:53:32.086 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.086 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.086 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.087 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.087 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.087 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.087 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.087 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.087 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.087 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.088 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.088 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.088 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.088 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.088 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.088 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.088 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.089 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.089 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.089 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.089 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.089 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.089 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.089 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.090 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.090 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.090 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.090 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.090 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.090 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.090 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.091 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.092 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.092 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.092 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.092 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.092 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.092 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.092 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.093 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.094 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.094 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.094 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.094 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.094 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.094 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj", 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.095 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.096 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.096 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.096 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.096 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.096 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.096 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.096 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.097 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.098 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.098 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.098 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.098 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.098 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.098 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.098 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.099 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.099 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.099 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.099 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.099 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.099 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.099 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.100 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.101 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.101 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.101 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.101 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.101 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.101 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.101 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.102 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.102 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.102 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.102 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.102 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.102 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.103 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.104 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.105 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.105 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.105 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.105 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.105 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.105 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.105 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.106 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.106 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.106 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.106 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.106 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.106 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.107 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.107 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.107 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.107 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.107 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.107 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.107 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.108 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.108 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.108 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.108 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.108 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.108 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.108 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.109 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.109 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.109 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.109 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.109 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.109 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.109 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.110 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.110 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.110 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.110 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.110 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.110 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.110 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.111 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.111 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.111 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.111 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.111 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:53:32.111 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.111 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.112 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.113 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.114 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.114 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.114 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.114 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.114 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.114 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.114 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.115 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.115 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.115 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.115 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.115 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.115 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.115 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.116 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.116 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.116 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.116 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.116 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.116 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.116 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.117 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.117 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.117 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.117 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.117 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.117 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.117 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.118 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.118 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.118 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.118 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.118 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.118 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.119 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.119 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.119 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.119 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.119 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.119 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.119 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.120 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:53:32.120 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.120 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.120 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.120 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.120 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.120 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.121 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.122 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.122 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.122 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.122 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.122 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.122 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.122 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.123 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.124 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.124 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.124 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.124 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.124 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.124 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.124 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.125 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.126 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.126 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.126 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.126 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.126 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.126 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.127 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.127 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.127 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.127 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.127 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.127 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.127 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.128 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.128 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.128 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:53:32.128 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.128 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.128 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.128 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.129 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.129 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.129 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.129 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.129 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.129 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.129 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.130 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.130 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.130 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.130 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.130 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.130 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.130 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.131 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.132 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.132 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.132 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.132 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.132 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.132 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.132 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.133 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.134 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.134 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.134 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.134 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.134 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.134 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.134 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.135 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.136 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.136 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.136 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.136 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:53:32.136 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.136 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.136 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.137 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.138 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.138 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.138 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.138 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.138 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.138 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.139 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.140 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.140 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.140 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.140 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.140 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.140 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.140 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.141 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.141 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.141 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.141 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.141 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.141 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.141 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.142 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.142 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.142 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.142 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.142 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.142 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.142 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.143 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.143 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.143 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.143 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.143 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.143 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.144 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.144 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.144 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.144 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.144 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.144 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.144 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.145 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:53:32.145 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.145 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.145 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.145 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.145 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.145 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.146 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.146 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.146 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.146 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.146 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.146 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.146 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.147 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.147 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.147 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.147 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.147 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.147 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.147 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.148 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.148 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.148 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.148 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.148 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.148 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.148 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.149 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.150 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.150 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.150 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.150 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.150 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.150 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.150 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.151 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.151 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.151 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.151 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.151 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.151 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.151 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.152 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.152 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.152 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.152 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.152 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.152 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.152 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.153 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.153 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.153 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.153 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj_", 2020-04-28T12:53:32.153 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.153 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.153 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.154 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.154 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.154 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.154 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.154 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.154 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.154 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.155 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.155 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.155 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.155 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.155 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.155 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.155 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.156 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.156 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.156 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.156 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.156 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.156 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.156 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.157 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.157 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.157 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.157 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.157 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.157 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.157 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.158 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.158 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.158 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.158 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.158 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.158 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.158 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.159 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.159 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.159 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.159 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.159 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.159 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.159 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.160 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.160 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.160 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.160 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.160 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.160 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.160 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.161 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.161 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.161 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.161 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.161 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.161 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.161 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.162 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj_", 2020-04-28T12:53:32.162 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.162 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.162 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.162 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.163 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.163 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.163 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.163 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.163 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.163 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.163 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.164 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.164 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.164 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.164 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.164 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.164 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.164 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.165 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.165 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.165 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.165 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.165 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.165 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.166 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.166 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.166 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.166 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.166 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.166 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.167 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.167 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.167 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.167 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.167 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.167 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.168 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.168 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.168 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.168 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.168 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.168 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.168 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.169 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.169 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.169 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.169 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.169 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.169 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.169 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.170 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.170 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.170 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.170 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.170 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.170 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.170 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.171 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.171 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.171 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:53:32.171 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.171 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.171 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.171 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.172 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.173 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.173 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.173 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.173 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.173 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.173 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.173 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.174 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.174 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.174 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.174 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.174 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.174 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.174 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.175 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.175 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.175 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.175 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.175 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.175 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.175 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.176 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.176 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.176 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.176 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.176 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.176 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.176 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.177 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.177 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.177 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.177 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.177 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.177 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.177 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.178 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.178 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.178 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.178 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.178 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.178 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.179 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.179 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.179 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.179 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.179 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.179 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.179 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:53:32.180 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.180 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.180 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.180 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.180 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.180 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.180 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.181 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.181 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.181 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.181 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.181 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.181 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.181 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.182 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.182 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.182 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.182 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.182 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.182 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.182 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.183 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.183 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.183 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.183 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.183 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.183 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.183 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.184 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.184 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.184 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.184 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.184 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.184 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.184 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.185 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.185 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.185 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.185 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.185 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.185 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.185 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.186 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.186 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.186 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.186 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.186 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.186 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.186 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.187 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.187 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.187 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.187 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.187 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.187 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.187 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.188 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.188 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.188 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.188 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:53:32.188 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.188 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.188 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.189 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.189 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.189 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.189 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.189 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.189 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.189 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.190 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.190 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.190 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.190 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.190 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.190 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.191 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.192 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.192 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.192 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.192 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.192 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.192 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.192 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.193 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.193 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.193 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.193 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.193 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.193 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.193 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.194 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.194 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.194 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.194 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.194 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.194 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.194 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.195 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.195 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.195 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.195 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.195 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.195 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.195 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.196 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.196 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.196 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.196 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.196 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.196 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.196 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.197 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:53:32.197 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.197 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.197 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.197 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.197 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.197 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.198 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.198 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.198 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.198 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.198 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.198 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.198 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.199 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.199 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.199 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.199 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.199 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.199 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.199 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.200 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.200 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.200 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.200 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.200 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.200 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.200 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.201 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.201 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.201 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.201 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.201 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.201 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.201 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.202 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.202 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.202 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.202 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.202 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.202 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.202 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.203 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.203 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.203 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.203 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.203 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.203 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.203 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.204 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.204 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.204 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.204 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.204 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.204 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.204 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.205 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.205 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.205 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.205 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": "default-placement.data", 2020-04-28T12:53:32.205 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:53:32.205 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.205 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.206 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.206 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.206 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.206 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.206 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "test", 2020-04-28T12:53:32.206 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.206 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.207 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.207 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.207 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": "", 2020-04-28T12:53:32.207 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.207 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": "" 2020-04-28T12:53:32.207 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.207 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.208 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.208 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.208 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.208 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.208 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.208 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.208 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.209 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.209 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.209 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.209 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.209 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.209 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.209 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.210 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.210 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.210 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.210 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.210 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.211 INFO:tasks.workunit.client.0.smithi026.stdout: "obj": { 2020-04-28T12:53:32.211 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.211 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.211 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.211 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.211 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.211 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.212 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.213 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.213 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.213 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.213 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.213 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.214 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:53:32.214 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.214 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.214 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.214 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.215 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.215 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.215 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.215 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.215 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.215 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.215 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.216 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.216 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.216 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.216 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.216 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.216 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.216 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.217 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.217 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2020-04-28T12:53:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] TestRGWObj.old_to_raw 2020-04-28T12:53:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.217 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.218 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.218 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker_myobj", 2020-04-28T12:53:32.218 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.218 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.219 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.219 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.219 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.219 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.219 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.219 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.220 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.220 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.220 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.220 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.220 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.220 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.220 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.221 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.221 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.221 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.221 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.221 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker_myobj 2020-04-28T12:53:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.222 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.222 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.222 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker_myobj", 2020-04-28T12:53:32.222 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.222 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.223 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.223 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.223 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.223 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.223 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.223 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.224 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.224 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.224 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.224 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.224 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.224 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.224 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker_myobj 2020-04-28T12:53:32.225 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.226 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.226 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.226 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:53:32.226 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.226 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.226 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.226 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.227 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.227 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.227 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.227 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.227 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.227 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.227 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.228 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.228 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.228 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.228 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.228 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.228 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.228 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.229 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.229 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.229 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.229 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.229 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.229 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__ns_myobj 2020-04-28T12:53:32.229 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.230 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.230 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.230 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns_myobj", 2020-04-28T12:53:32.230 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.230 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.230 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.231 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.231 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.231 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.231 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.231 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.231 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.231 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.232 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.232 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.232 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.232 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.232 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.232 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.232 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.233 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.233 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.233 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.233 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.233 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.233 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.233 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__ns_myobj 2020-04-28T12:53:32.234 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.234 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.234 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.234 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:53:32.234 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.234 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.234 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.235 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.235 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.235 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.235 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.235 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.235 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.235 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.236 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.236 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.236 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.236 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.236 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.236 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.236 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.237 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.237 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.237 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.237 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.237 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.237 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.237 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__:inst_myobj 2020-04-28T12:53:32.238 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.238 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.238 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.238 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst_myobj", 2020-04-28T12:53:32.238 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.238 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.238 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.239 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.239 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.239 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.239 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.239 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.239 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.239 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.240 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.240 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.240 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.240 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.240 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.240 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.240 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.241 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.241 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.241 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.241 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.241 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.241 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.241 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__:inst_myobj 2020-04-28T12:53:32.242 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.242 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.242 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.242 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:53:32.242 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.242 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.242 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.243 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.243 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.243 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.243 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.243 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.243 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.243 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.244 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.244 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.244 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.244 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.244 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.244 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.244 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.245 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.245 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.245 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.245 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.245 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.245 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.245 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__ns:inst_myobj 2020-04-28T12:53:32.246 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.246 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.246 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.246 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst_myobj", 2020-04-28T12:53:32.246 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.246 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.247 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.247 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.247 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.247 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.247 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.247 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.247 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.248 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.248 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.248 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.248 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.248 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.248 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.248 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.249 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.249 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "myobj", 2020-04-28T12:53:32.249 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.249 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.249 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.249 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.249 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.250 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__ns:inst_myobj 2020-04-28T12:53:32.250 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.250 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.250 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.250 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj", 2020-04-28T12:53:32.250 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.250 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.251 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.251 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.251 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.251 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.251 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.251 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.251 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.252 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.252 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.252 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.252 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.252 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.252 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.252 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.253 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker___myobj 2020-04-28T12:53:32.254 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.254 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.254 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.254 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj", 2020-04-28T12:53:32.254 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.254 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.255 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.255 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.255 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.255 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.255 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.255 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.255 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.256 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.256 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.256 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.256 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.256 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.256 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.256 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.257 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker___myobj 2020-04-28T12:53:32.258 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.258 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.258 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.258 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:53:32.258 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.258 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.259 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.260 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.260 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.260 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.260 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.260 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.260 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.260 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.261 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.261 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.261 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.261 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.262 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.262 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.262 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__ns__myobj 2020-04-28T12:53:32.262 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.262 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.263 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.263 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj", 2020-04-28T12:53:32.263 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.263 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.263 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.264 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.264 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.264 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.264 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.264 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.264 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.265 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.265 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.265 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.265 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.265 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.265 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.265 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.266 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.266 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.266 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.266 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.266 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.266 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.267 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.267 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__ns__myobj 2020-04-28T12:53:32.267 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.267 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.267 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.267 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:53:32.267 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.268 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.268 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.268 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.268 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.268 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.268 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.269 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.269 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.269 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.269 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.269 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.269 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.269 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.270 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.270 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.270 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.270 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.270 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.270 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.270 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.271 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.271 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.271 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__:inst__myobj 2020-04-28T12:53:32.271 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.271 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.271 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.271 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj", 2020-04-28T12:53:32.272 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj" 2020-04-28T12:53:32.272 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.272 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.272 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.272 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.272 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.272 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.273 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.273 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.273 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.273 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.273 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.273 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.273 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.274 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.274 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.274 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.274 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.274 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.274 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.275 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.275 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.275 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.275 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__:inst__myobj 2020-04-28T12:53:32.275 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.275 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.275 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.276 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.277 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.277 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.277 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.277 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.277 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.277 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.277 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.278 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.278 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.278 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.278 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.278 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.278 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__ns:inst__myobj 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.279 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj", 2020-04-28T12:53:32.280 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.280 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.280 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.280 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.280 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.280 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.280 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.281 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.281 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.281 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.281 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.281 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.281 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.281 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.282 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.282 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.282 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.282 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj", 2020-04-28T12:53:32.282 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.282 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.282 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.283 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.283 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.283 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__ns:inst__myobj 2020-04-28T12:53:32.283 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.283 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.283 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.283 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj_", 2020-04-28T12:53:32.284 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.284 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.284 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.284 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.284 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.284 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.284 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.285 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.286 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.286 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.286 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.286 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.286 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.286 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.287 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.287 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.287 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker___myobj_ 2020-04-28T12:53:32.287 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.287 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.287 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.287 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker___myobj_", 2020-04-28T12:53:32.288 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.288 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.288 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.288 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.288 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.288 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.288 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.289 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.289 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.289 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.289 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.289 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.289 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.289 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.290 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.290 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.290 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.290 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.290 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.290 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.290 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker___myobj_ 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:53:32.291 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.292 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.292 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.292 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.292 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.292 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.292 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.292 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.293 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.293 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.293 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.293 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.293 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.293 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.293 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.294 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.295 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__ns__myobj_ 2020-04-28T12:53:32.295 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.295 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.295 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.295 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns__myobj_", 2020-04-28T12:53:32.295 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.295 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.296 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.296 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.296 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.296 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.296 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.296 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.296 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.297 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.297 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.297 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.297 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.297 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.297 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.297 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "", 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.298 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__ns__myobj_ 2020-04-28T12:53:32.299 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.299 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.299 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.299 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:53:32.299 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.299 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.299 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.300 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.300 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.300 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.300 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.300 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.300 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.300 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.301 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.301 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.301 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.301 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.301 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.301 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.301 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.302 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.302 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.302 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.302 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.302 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.302 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.302 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__:inst__myobj_ 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__:inst__myobj_", 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "marker__myobj_" 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.303 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.304 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.304 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.304 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.304 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.304 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.304 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.304 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.305 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.305 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.305 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.305 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.305 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.305 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.305 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.306 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.306 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "" 2020-04-28T12:53:32.306 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.306 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.306 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.306 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__:inst__myobj_ 2020-04-28T12:53:32.306 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj": { 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.307 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj": { 2020-04-28T12:53:32.308 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.308 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.308 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.308 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.308 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.308 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.309 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.309 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.309 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.309 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.309 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.309 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.309 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.310 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.310 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.310 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.310 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.310 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.310 INFO:tasks.workunit.client.0.smithi026.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:53:32.310 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.311 INFO:tasks.workunit.client.0.smithi026.stdout: "raw_obj2": { 2020-04-28T12:53:32.311 INFO:tasks.workunit.client.0.smithi026.stdout: "pool": ".data-pool", 2020-04-28T12:53:32.311 INFO:tasks.workunit.client.0.smithi026.stdout: "oid": "marker__ns:inst__myobj_", 2020-04-28T12:53:32.311 INFO:tasks.workunit.client.0.smithi026.stdout: "loc": "" 2020-04-28T12:53:32.311 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.311 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.311 INFO:tasks.workunit.client.0.smithi026.stdout:{ 2020-04-28T12:53:32.312 INFO:tasks.workunit.client.0.smithi026.stdout: "new_obj2": { 2020-04-28T12:53:32.312 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket": { 2020-04-28T12:53:32.312 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "ebtest", 2020-04-28T12:53:32.312 INFO:tasks.workunit.client.0.smithi026.stdout: "marker": "marker", 2020-04-28T12:53:32.312 INFO:tasks.workunit.client.0.smithi026.stdout: "bucket_id": "bucket-id", 2020-04-28T12:53:32.312 INFO:tasks.workunit.client.0.smithi026.stdout: "tenant": "", 2020-04-28T12:53:32.312 INFO:tasks.workunit.client.0.smithi026.stdout: "explicit_placement": { 2020-04-28T12:53:32.313 INFO:tasks.workunit.client.0.smithi026.stdout: "data_pool": ".data-pool", 2020-04-28T12:53:32.313 INFO:tasks.workunit.client.0.smithi026.stdout: "data_extra_pool": "", 2020-04-28T12:53:32.313 INFO:tasks.workunit.client.0.smithi026.stdout: "index_pool": ".index-pool" 2020-04-28T12:53:32.313 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.313 INFO:tasks.workunit.client.0.smithi026.stdout: }, 2020-04-28T12:53:32.313 INFO:tasks.workunit.client.0.smithi026.stdout: "key": { 2020-04-28T12:53:32.313 INFO:tasks.workunit.client.0.smithi026.stdout: "name": "_myobj_", 2020-04-28T12:53:32.314 INFO:tasks.workunit.client.0.smithi026.stdout: "instance": "inst", 2020-04-28T12:53:32.314 INFO:tasks.workunit.client.0.smithi026.stdout: "ns": "ns" 2020-04-28T12:53:32.314 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.314 INFO:tasks.workunit.client.0.smithi026.stdout: } 2020-04-28T12:53:32.314 INFO:tasks.workunit.client.0.smithi026.stdout:} 2020-04-28T12:53:32.314 INFO:tasks.workunit.client.0.smithi026.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2020-04-28T12:53:32.314 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2020-04-28T12:53:32.315 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2020-04-28T12:53:32.315 INFO:tasks.workunit.client.0.smithi026.stdout: 2020-04-28T12:53:32.315 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2020-04-28T12:53:32.315 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2020-04-28T12:53:32.315 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 4 tests. 2020-04-28T12:53:32.315 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:32.332 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:53:32.332 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:53:32.411 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_throttle.sh on client.0... 2020-04-28T12:53:32.411 INFO:tasks.workunit:Running workunit rgw/test_rgw_throttle.sh... 2020-04-28T12:53:32.411 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:32.463 INFO:teuthology.orchestra.run.smithi026:workunit test rgw/test_rgw_throttle.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c125c7d78f5cd973863993d258cd717ade4c99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_throttle.sh 2020-04-28T12:53:32.545 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] Running 5 tests from 1 test suite. 2020-04-28T12:53:32.545 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment set-up. 2020-04-28T12:53:33.660 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from Aio_Throttle 2020-04-28T12:53:33.660 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] Aio_Throttle.NoThrottleUpToMax 2020-04-28T12:53:33.660 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] Aio_Throttle.NoThrottleUpToMax (0 ms) 2020-04-28T12:53:33.660 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] Aio_Throttle.CostOverWindow 2020-04-28T12:53:33.661 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] Aio_Throttle.CostOverWindow (0 ms) 2020-04-28T12:53:33.661 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] Aio_Throttle.ThrottleOverMax 2020-04-28T12:53:33.749 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] Aio_Throttle.ThrottleOverMax (89 ms) 2020-04-28T12:53:33.749 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] Aio_Throttle.YieldCostOverWindow 2020-04-28T12:53:33.750 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] Aio_Throttle.YieldCostOverWindow (0 ms) 2020-04-28T12:53:33.750 INFO:tasks.workunit.client.0.smithi026.stdout:[ RUN ] Aio_Throttle.YieldingThrottleOverMax 2020-04-28T12:53:33.837 INFO:tasks.workunit.client.0.smithi026.stdout:[ OK ] Aio_Throttle.YieldingThrottleOverMax (87 ms) 2020-04-28T12:53:33.837 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] 5 tests from Aio_Throttle (177 ms total) 2020-04-28T12:53:33.838 INFO:tasks.workunit.client.0.smithi026.stdout: 2020-04-28T12:53:33.838 INFO:tasks.workunit.client.0.smithi026.stdout:[----------] Global test environment tear-down 2020-04-28T12:53:33.838 INFO:tasks.workunit.client.0.smithi026.stdout:[==========] 5 tests from 1 test suite ran. (1293 ms total) 2020-04-28T12:53:33.838 INFO:tasks.workunit.client.0.smithi026.stdout:[ PASSED ] 5 tests. 2020-04-28T12:53:33.841 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:33.895 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-04-28T12:53:33.896 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-04-28T12:53:33.970 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_rgw_throttle.sh'] on client.0... 2020-04-28T12:53:33.971 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:34.023 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-04-28T12:53:34.260 DEBUG:teuthology.parallel:result is None 2020-04-28T12:53:34.260 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:34.274 INFO:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:53:34.345 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:53:34.345 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:34.399 INFO:teuthology.orchestra.run.smithi026:> rmdir -- /home/ubuntu/cephtest/mnt.0 2020-04-28T12:53:34.453 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2020-04-28T12:53:34.454 INFO:teuthology.run_tasks:Running task ragweed... 2020-04-28T12:53:34.470 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2020-04-28T12:53:34.471 INFO:tasks.ragweed:Downloading ragweed... 2020-04-28T12:53:34.471 INFO:tasks.ragweed:Using branch 'octopus' for ragweed 2020-04-28T12:53:34.471 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:34.507 INFO:teuthology.orchestra.run.smithi026:> git clone -b octopus git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:53:34.560 INFO:teuthology.orchestra.run.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:53:34.571 INFO:teuthology.orchestra.run.smithi026.stderr:fatal: Remote branch octopus not found in upstream origin 2020-04-28T12:53:34.572 DEBUG:teuthology.orchestra.run:got remote process result: 128 2020-04-28T12:53:34.572 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:34.626 INFO:teuthology.orchestra.run.smithi026:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2020-04-28T12:53:34.681 INFO:teuthology.orchestra.run.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/ragweed'... 2020-04-28T12:53:34.821 INFO:tasks.ragweed:Creating rgw users... 2020-04-28T12:53:34.822 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2020-04-28T12:53:34.822 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:34.875 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key RJNLUHOVUMUQFQRZIYBF --secret 5q8QEXLt+pXU//1Zr3kD8eHJVH2reRjYC6NyauZbpRBiFdRYxcSgyw== --email sysuser.client.0+test@test.test --system true 2020-04-28T12:53:34.967 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.963+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:34.972 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.967+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:34.972 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.967+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:34.972 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.968+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:34.972 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.968+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:34.973 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.968+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:34.973 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.968+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:34.977 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.973+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.000 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.996+0000 7f9763157180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:53:35.000 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.996+0000 7f9763157180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:53:35.001 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.996+0000 7f9763157180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:53:35.001 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.996+0000 7f9763157180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:53:35.001 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.996+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.002 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.996+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.002 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.996+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.002 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.997+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:53:35.002 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.997+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.002 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.997+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.002 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.997+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.003 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.998+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:53:35.003 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.998+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.998+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.998+0000 7f9763157180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:53:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.998+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.999+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.999+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.999+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:34.999+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:53:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 20 zonegroup default 2020-04-28T12:53:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 10 Cannot find current period zone using local zone 2020-04-28T12:53:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.000+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.001+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.001+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.001+0000 7f9763157180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:53:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.001+0000 7f9763157180 20 zone default found 2020-04-28T12:53:35.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.001+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.002+0000 7f975093f700 0 -- 172.21.15.26:0/4215889124 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7f9744002670 msgr2=0x7f9744002ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:53:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.002+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.002+0000 7f9763157180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.002+0000 7f9763157180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.002+0000 7f9763157180 20 started sync module instance, tier type = 2020-04-28T12:53:35.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.002+0000 7f9763157180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:53:35.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.014+0000 7f9763157180 20 add_watcher() i=0 2020-04-28T12:53:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.014+0000 7f9763157180 20 add_watcher() i=1 2020-04-28T12:53:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.014+0000 7f9763157180 20 add_watcher() i=2 2020-04-28T12:53:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.014+0000 7f9763157180 20 add_watcher() i=3 2020-04-28T12:53:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.014+0000 7f9763157180 20 add_watcher() i=4 2020-04-28T12:53:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.014+0000 7f9763157180 20 add_watcher() i=5 2020-04-28T12:53:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.014+0000 7f9763157180 20 add_watcher() i=6 2020-04-28T12:53:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.015+0000 7f9763157180 20 add_watcher() i=7 2020-04-28T12:53:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.015+0000 7f9763157180 2 all 8 watchers are set, enabling cache 2020-04-28T12:53:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.015+0000 7f9763157180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:53:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.015+0000 7f9763157180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:53:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.015+0000 7f9721fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:53:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.016+0000 7f975093f700 0 -- 172.21.15.26:0/3364887511 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x5587ad2e0bd0 msgr2=0x5587ad2e2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2020-04-28T12:53:35.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.067+0000 7f9693fff700 20 reqs_thread_entry: start 2020-04-28T12:53:35.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.067+0000 7f9691ffb700 20 reqs_thread_entry: start 2020-04-28T12:53:35.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f9763157180 20 init_complete bucket index max shards: 1999 2020-04-28T12:53:35.073 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f967ffff700 20 reqs_thread_entry: start 2020-04-28T12:53:35.073 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f9763157180 20 get_system_obj_state: rctx=0x7ffc808269f8 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5587ad185170 s->prefetch_data=0 2020-04-28T12:53:35.073 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f9763157180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:53:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2020-04-28T12:53:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f9763157180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:53:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f9763157180 20 get_system_obj_state: rctx=0x7ffc80826a08 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x5587ad185170 s->prefetch_data=0 2020-04-28T12:53:35.078 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.068+0000 7f9763157180 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2020-04-28T12:53:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2020-04-28T12:53:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:53:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 20 get_system_obj_state: rctx=0x7ffc80826a08 obj=default.rgw.meta:users.keys:RJNLUHOVUMUQFQRZIYBF state=0x5587ad185170 s->prefetch_data=0 2020-04-28T12:53:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 cache get: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF : miss 2020-04-28T12:53:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF info.flags=0x0 2020-04-28T12:53:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 adding default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF to cache LRU end 2020-04-28T12:53:35.079 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 20 get_system_obj_state: rctx=0x7ffc80826418 obj=default.rgw.meta:users.keys:RJNLUHOVUMUQFQRZIYBF state=0x5587ad185170 s->prefetch_data=0 2020-04-28T12:53:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 cache get: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF : type miss (requested=0x6, cached=0x0) 2020-04-28T12:53:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF info.flags=0x0 2020-04-28T12:53:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.069+0000 7f9763157180 10 moving default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF to cache LRU end 2020-04-28T12:53:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.070+0000 7f9763157180 20 get_system_obj_state: rctx=0x7ffc80826708 obj=default.rgw.meta:users.keys:RJNLUHOVUMUQFQRZIYBF state=0x5587ad185170 s->prefetch_data=0 2020-04-28T12:53:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.070+0000 7f9763157180 10 cache get: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF : type miss (requested=0x6, cached=0x0) 2020-04-28T12:53:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.070+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF info.flags=0x0 2020-04-28T12:53:35.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.070+0000 7f9763157180 10 moving default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF to cache LRU end 2020-04-28T12:53:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.072+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:53:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.072+0000 7f9763157180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:53:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.072+0000 7f9763157180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2020-04-28T12:53:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.073+0000 7f97327fc700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94041214336448 notifier 4472 bl.length()=637 2020-04-28T12:53:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.073+0000 7f97327fc700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2020-04-28T12:53:35.081 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.073+0000 7f97327fc700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:53:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.075+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:53:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.075+0000 7f9763157180 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:53:35.082 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.075+0000 7f9763157180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2020-04-28T12:53:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.075+0000 7f97327fc700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94041214342576 notifier 4472 bl.length()=202 2020-04-28T12:53:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.075+0000 7f97327fc700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2020-04-28T12:53:35.083 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.075+0000 7f97327fc700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2020-04-28T12:53:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.078+0000 7f9763157180 10 cache put: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF info.flags=0x7 2020-04-28T12:53:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.078+0000 7f9763157180 10 moving default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF to cache LRU end 2020-04-28T12:53:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.078+0000 7f9763157180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=190 2020-04-28T12:53:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.078+0000 7f97327fc700 10 RGWWatcher::handle_notify() notify_id 506806140928 cookie 94041214334224 notifier 4472 bl.length()=190 2020-04-28T12:53:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.078+0000 7f97327fc700 10 cache put: name=default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF info.flags=0x7 2020-04-28T12:53:35.084 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.078+0000 7f97327fc700 10 moving default.rgw.meta+users.keys+RJNLUHOVUMUQFQRZIYBF to cache LRU end 2020-04-28T12:53:35.085 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.079+0000 7f9721fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:53:35.085 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2020-04-28T12:53:35.085 INFO:teuthology.orchestra.run.smithi026.stdout: "user_id": "sysuser.client.0", 2020-04-28T12:53:35.085 INFO:teuthology.orchestra.run.smithi026.stdout: "display_name": "Mr. sysuser.client.0", 2020-04-28T12:53:35.085 INFO:teuthology.orchestra.run.smithi026.stdout: "email": "sysuser.client.0+test@test.test", 2020-04-28T12:53:35.085 INFO:teuthology.orchestra.run.smithi026.stdout: "suspended": 0, 2020-04-28T12:53:35.085 INFO:teuthology.orchestra.run.smithi026.stdout: "max_buckets": 1000, 2020-04-28T12:53:35.086 INFO:teuthology.orchestra.run.smithi026.stdout: "subusers": [], 2020-04-28T12:53:35.086 INFO:teuthology.orchestra.run.smithi026.stdout: "keys": [ 2020-04-28T12:53:35.086 INFO:teuthology.orchestra.run.smithi026.stdout: { 2020-04-28T12:53:35.086 INFO:teuthology.orchestra.run.smithi026.stdout: "user": "sysuser.client.0", 2020-04-28T12:53:35.086 INFO:teuthology.orchestra.run.smithi026.stdout: "access_key": "RJNLUHOVUMUQFQRZIYBF", 2020-04-28T12:53:35.086 INFO:teuthology.orchestra.run.smithi026.stdout: "secret_key": "5q8QEXLt+pXU//1Zr3kD8eHJVH2reRjYC6NyauZbpRBiFdRYxcSgyw==" 2020-04-28T12:53:35.086 INFO:teuthology.orchestra.run.smithi026.stdout: } 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: "swift_keys": [], 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": [], 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: "op_mask": "read, write, delete", 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: "system": "true", 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: "default_placement": "", 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: "default_storage_class": "", 2020-04-28T12:53:35.087 INFO:teuthology.orchestra.run.smithi026.stdout: "placement_tags": [], 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: "bucket_quota": { 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": false, 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: "check_on_raw": false, 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size": -1, 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size_kb": 0, 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: "max_objects": -1 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2020-04-28T12:53:35.088 INFO:teuthology.orchestra.run.smithi026.stdout: "user_quota": { 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": false, 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: "check_on_raw": false, 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size": -1, 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size_kb": 0, 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: "max_objects": -1 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: "temp_url_keys": [], 2020-04-28T12:53:35.089 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "rgw", 2020-04-28T12:53:35.090 INFO:teuthology.orchestra.run.smithi026.stdout: "mfa_ids": [] 2020-04-28T12:53:35.090 INFO:teuthology.orchestra.run.smithi026.stdout:} 2020-04-28T12:53:35.090 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.081+0000 7f9763157180 20 remove_watcher() i=0 2020-04-28T12:53:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.081+0000 7f9763157180 2 removed watcher, disabling cache 2020-04-28T12:53:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.082+0000 7f9763157180 20 remove_watcher() i=1 2020-04-28T12:53:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.083+0000 7f9763157180 20 remove_watcher() i=2 2020-04-28T12:53:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.085+0000 7f9763157180 20 remove_watcher() i=3 2020-04-28T12:53:35.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.086+0000 7f9763157180 20 remove_watcher() i=4 2020-04-28T12:53:35.092 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.088+0000 7f9763157180 20 remove_watcher() i=5 2020-04-28T12:53:35.093 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.089+0000 7f9763157180 20 remove_watcher() i=6 2020-04-28T12:53:35.095 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.090+0000 7f9763157180 20 remove_watcher() i=7 2020-04-28T12:53:35.099 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2020-04-28T12:53:35.099 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:35.113 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key KONFRKUBOJTKLEGDYSRW --secret pJeAOYChloBeeXJuP5ZRepmbxo7FUTuPjs6AJR1qW/6gGL8VOXpK6A== --email ragweed.client.0+test@test.test --system false 2020-04-28T12:53:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.199+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.200+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.200+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.201+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.201+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.201+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.201+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.202+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.217+0000 7f24d1ce9180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:53:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.217+0000 7f24d1ce9180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:53:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.217+0000 7f24d1ce9180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:53:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.217+0000 7f24d1ce9180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:53:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.217+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.218+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.218+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.218+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:53:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.218+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.218+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.219+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.219+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:53:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.219+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.219+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.219+0000 7f24d1ce9180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:53:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.219+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.220+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.220+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.220+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.220+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.220+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:53:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.220+0000 7f24d1ce9180 20 zonegroup default 2020-04-28T12:53:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.220+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.221+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.221+0000 7f24d1ce9180 10 Cannot find current period zone using local zone 2020-04-28T12:53:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.221+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.221+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.221+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.221+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:53:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.221+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.222+0000 7f24d1ce9180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:53:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.222+0000 7f24d1ce9180 20 zone default found 2020-04-28T12:53:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.222+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.222+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.222+0000 7f24d1ce9180 20 rados->read ofs=0 len=0 2020-04-28T12:53:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.223+0000 7f24d1ce9180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:53:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.223+0000 7f24d1ce9180 20 started sync module instance, tier type = 2020-04-28T12:53:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.223+0000 7f24d1ce9180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:53:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.224+0000 7f24bf4d1700 0 -- 172.21.15.26:0/519946621 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x560fc5884e10 msgr2=0x560fc5887290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:53:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.234+0000 7f24d1ce9180 20 add_watcher() i=0 2020-04-28T12:53:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.234+0000 7f24d1ce9180 20 add_watcher() i=1 2020-04-28T12:53:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.234+0000 7f24d1ce9180 20 add_watcher() i=2 2020-04-28T12:53:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.234+0000 7f24d1ce9180 20 add_watcher() i=3 2020-04-28T12:53:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.234+0000 7f24d1ce9180 20 add_watcher() i=4 2020-04-28T12:53:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.234+0000 7f24d1ce9180 20 add_watcher() i=5 2020-04-28T12:53:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.234+0000 7f24d1ce9180 20 add_watcher() i=6 2020-04-28T12:53:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.236+0000 7f24d1ce9180 20 add_watcher() i=7 2020-04-28T12:53:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.236+0000 7f24d1ce9180 2 all 8 watchers are set, enabling cache 2020-04-28T12:53:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.236+0000 7f24d1ce9180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:53:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.236+0000 7f24d1ce9180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:53:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.236+0000 7f2413fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:53:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.236+0000 7f24c04d3700 0 -- 172.21.15.26:0/3379523333 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x560fc589e570 msgr2=0x560fc589e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:53:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.286+0000 7f23fe7fc700 20 reqs_thread_entry: start 2020-04-28T12:53:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.286+0000 7f23f7fff700 20 reqs_thread_entry: start 2020-04-28T12:53:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.286+0000 7f24d1ce9180 20 init_complete bucket index max shards: 1999 2020-04-28T12:53:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.287+0000 7f23f67fc700 20 reqs_thread_entry: start 2020-04-28T12:53:35.292 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.287+0000 7f24d1ce9180 20 get_system_obj_state: rctx=0x7fffea281658 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x560fc574b170 s->prefetch_data=0 2020-04-28T12:53:35.292 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.287+0000 7f24d1ce9180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:53:35.293 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.287+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2020-04-28T12:53:35.293 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.287+0000 7f24d1ce9180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:53:35.293 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.287+0000 7f24d1ce9180 20 get_system_obj_state: rctx=0x7fffea281668 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x560fc574b170 s->prefetch_data=0 2020-04-28T12:53:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.287+0000 7f24d1ce9180 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2020-04-28T12:53:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2020-04-28T12:53:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:53:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 20 get_system_obj_state: rctx=0x7fffea281668 obj=default.rgw.meta:users.keys:KONFRKUBOJTKLEGDYSRW state=0x560fc574b170 s->prefetch_data=0 2020-04-28T12:53:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 cache get: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW : miss 2020-04-28T12:53:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW info.flags=0x0 2020-04-28T12:53:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 adding default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW to cache LRU end 2020-04-28T12:53:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 20 get_system_obj_state: rctx=0x7fffea281078 obj=default.rgw.meta:users.keys:KONFRKUBOJTKLEGDYSRW state=0x560fc574b170 s->prefetch_data=0 2020-04-28T12:53:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 cache get: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW : type miss (requested=0x6, cached=0x0) 2020-04-28T12:53:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW info.flags=0x0 2020-04-28T12:53:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 moving default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW to cache LRU end 2020-04-28T12:53:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 20 get_system_obj_state: rctx=0x7fffea281368 obj=default.rgw.meta:users.keys:KONFRKUBOJTKLEGDYSRW state=0x560fc574b170 s->prefetch_data=0 2020-04-28T12:53:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.288+0000 7f24d1ce9180 10 cache get: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW : type miss (requested=0x6, cached=0x0) 2020-04-28T12:53:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.289+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW info.flags=0x0 2020-04-28T12:53:35.296 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.289+0000 7f24d1ce9180 10 moving default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW to cache LRU end 2020-04-28T12:53:35.296 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.290+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:53:35.296 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.290+0000 7f24d1ce9180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:53:35.296 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.290+0000 7f24d1ce9180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2020-04-28T12:53:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.291+0000 7f24b57fa700 10 RGWWatcher::handle_notify() notify_id 506806140929 cookie 94625738550416 notifier 4478 bl.length()=637 2020-04-28T12:53:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.291+0000 7f24b57fa700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2020-04-28T12:53:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.291+0000 7f24b57fa700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:53:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.293+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:53:35.298 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.293+0000 7f24d1ce9180 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:53:35.298 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.293+0000 7f24d1ce9180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2020-04-28T12:53:35.298 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.293+0000 7f24b57fa700 10 RGWWatcher::handle_notify() notify_id 506806140929 cookie 94625738545040 notifier 4478 bl.length()=202 2020-04-28T12:53:35.298 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.293+0000 7f24b57fa700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2020-04-28T12:53:35.298 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.293+0000 7f24b57fa700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2020-04-28T12:53:35.300 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.295+0000 7f24d1ce9180 10 cache put: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW info.flags=0x7 2020-04-28T12:53:35.300 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.295+0000 7f24d1ce9180 10 moving default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW to cache LRU end 2020-04-28T12:53:35.300 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.295+0000 7f24d1ce9180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=190 2020-04-28T12:53:35.301 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.296+0000 7f24b57fa700 10 RGWWatcher::handle_notify() notify_id 506806140930 cookie 94625737137088 notifier 4478 bl.length()=190 2020-04-28T12:53:35.301 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.296+0000 7f24b57fa700 10 cache put: name=default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW info.flags=0x7 2020-04-28T12:53:35.301 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.296+0000 7f24b57fa700 10 moving default.rgw.meta+users.keys+KONFRKUBOJTKLEGDYSRW to cache LRU end 2020-04-28T12:53:35.301 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.296+0000 7f2413fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:53:35.301 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2020-04-28T12:53:35.302 INFO:teuthology.orchestra.run.smithi026.stdout: "user_id": "ragweed.client.0", 2020-04-28T12:53:35.302 INFO:teuthology.orchestra.run.smithi026.stdout: "display_name": "Mr. ragweed.client.0", 2020-04-28T12:53:35.302 INFO:teuthology.orchestra.run.smithi026.stdout: "email": "ragweed.client.0+test@test.test", 2020-04-28T12:53:35.302 INFO:teuthology.orchestra.run.smithi026.stdout: "suspended": 0, 2020-04-28T12:53:35.302 INFO:teuthology.orchestra.run.smithi026.stdout: "max_buckets": 1000, 2020-04-28T12:53:35.302 INFO:teuthology.orchestra.run.smithi026.stdout: "subusers": [], 2020-04-28T12:53:35.302 INFO:teuthology.orchestra.run.smithi026.stdout: "keys": [ 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: { 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: "user": "ragweed.client.0", 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: "access_key": "KONFRKUBOJTKLEGDYSRW", 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: "secret_key": "pJeAOYChloBeeXJuP5ZRepmbxo7FUTuPjs6AJR1qW/6gGL8VOXpK6A==" 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: } 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: "swift_keys": [], 2020-04-28T12:53:35.303 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": [], 2020-04-28T12:53:35.304 INFO:teuthology.orchestra.run.smithi026.stdout: "op_mask": "read, write, delete", 2020-04-28T12:53:35.304 INFO:teuthology.orchestra.run.smithi026.stdout: "default_placement": "", 2020-04-28T12:53:35.304 INFO:teuthology.orchestra.run.smithi026.stdout: "default_storage_class": "", 2020-04-28T12:53:35.304 INFO:teuthology.orchestra.run.smithi026.stdout: "placement_tags": [], 2020-04-28T12:53:35.304 INFO:teuthology.orchestra.run.smithi026.stdout: "bucket_quota": { 2020-04-28T12:53:35.304 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": false, 2020-04-28T12:53:35.304 INFO:teuthology.orchestra.run.smithi026.stdout: "check_on_raw": false, 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size": -1, 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size_kb": 0, 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: "max_objects": -1 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: "user_quota": { 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": false, 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: "check_on_raw": false, 2020-04-28T12:53:35.305 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size": -1, 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size_kb": 0, 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout: "max_objects": -1 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout: "temp_url_keys": [], 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "rgw", 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout: "mfa_ids": [] 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:} 2020-04-28T12:53:35.306 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:35.307 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.298+0000 7f24d1ce9180 20 remove_watcher() i=0 2020-04-28T12:53:35.307 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.298+0000 7f24d1ce9180 2 removed watcher, disabling cache 2020-04-28T12:53:35.307 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.299+0000 7f24d1ce9180 20 remove_watcher() i=1 2020-04-28T12:53:35.308 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.301+0000 7f24d1ce9180 20 remove_watcher() i=2 2020-04-28T12:53:35.308 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.302+0000 7f24d1ce9180 20 remove_watcher() i=3 2020-04-28T12:53:35.308 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.304+0000 7f24d1ce9180 20 remove_watcher() i=4 2020-04-28T12:53:35.309 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.305+0000 7f24d1ce9180 20 remove_watcher() i=5 2020-04-28T12:53:35.311 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.306+0000 7f24d1ce9180 20 remove_watcher() i=6 2020-04-28T12:53:35.312 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:53:35.308+0000 7f24d1ce9180 20 remove_watcher() i=7 2020-04-28T12:53:35.316 INFO:tasks.ragweed:Configuring ragweed... 2020-04-28T12:53:35.316 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:35.330 INFO:teuthology.orchestra.run.smithi026:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2020-04-28T12:53:38.770 INFO:teuthology.orchestra.run.smithi026.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2020-04-28T12:53:39.192 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:07:49 ago on Tue 28 Apr 2020 12:45:50 PM UTC. 2020-04-28T12:53:39.445 INFO:teuthology.orchestra.run.smithi026.stdout:Package python36-devel-3.6.8-2.module_el8.1.0+245+c39af44f.x86_64 is already installed. 2020-04-28T12:53:39.554 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2020-04-28T12:53:39.555 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:53:39.555 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2020-04-28T12:53:39.556 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:53:39.556 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2020-04-28T12:53:39.556 INFO:teuthology.orchestra.run.smithi026.stdout: libevent-devel x86_64 2.1.8-5.el8 CentOS-AppStream 104 k 2020-04-28T12:53:39.556 INFO:teuthology.orchestra.run.smithi026.stdout: libxml2-devel x86_64 2.9.7-5.el8 CentOS-AppStream 1.0 M 2020-04-28T12:53:39.556 INFO:teuthology.orchestra.run.smithi026.stdout: libxslt-devel x86_64 1.1.32-3.el8 CentOS-AppStream 322 k 2020-04-28T12:53:39.556 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-10.el8 CentOS-Base 56 k 2020-04-28T12:53:39.556 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout: cmake-filesystem x86_64 3.11.4-3.el8 CentOS-AppStream 40 k 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout: libgcrypt-devel x86_64 1.8.3-4.el8 CentOS-Base 149 k 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout: libgpg-error-devel x86_64 1.31-1.el8 CentOS-Base 64 k 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout: xz-devel x86_64 5.2.4-3.el8 CentOS-Base 62 k 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2020-04-28T12:53:39.557 INFO:teuthology.orchestra.run.smithi026.stdout:Install 8 Packages 2020-04-28T12:53:39.558 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:39.558 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 1.8 M 2020-04-28T12:53:39.558 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 12 M 2020-04-28T12:53:39.558 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2020-04-28T12:53:39.600 INFO:teuthology.orchestra.run.smithi026.stdout:(1/8): cmake-filesystem-3.11.4-3.el8.x86_64.rpm 954 kB/s | 40 kB 00:00 2020-04-28T12:53:39.609 INFO:teuthology.orchestra.run.smithi026.stdout:(2/8): libevent-devel-2.1.8-5.el8.x86_64.rpm 2.0 MB/s | 104 kB 00:00 2020-04-28T12:53:39.610 INFO:teuthology.orchestra.run.smithi026.stdout:(3/8): libxslt-devel-1.1.32-3.el8.x86_64.rpm 31 MB/s | 322 kB 00:00 2020-04-28T12:53:39.613 INFO:teuthology.orchestra.run.smithi026.stdout:(4/8): libgpg-error-devel-1.31-1.el8.x86_64.rpm 25 MB/s | 64 kB 00:00 2020-04-28T12:53:39.614 INFO:teuthology.orchestra.run.smithi026.stdout:(5/8): libgcrypt-devel-1.8.3-4.el8.x86_64.rpm 26 MB/s | 149 kB 00:00 2020-04-28T12:53:39.616 INFO:teuthology.orchestra.run.smithi026.stdout:(6/8): xz-devel-5.2.4-3.el8.x86_64.rpm 21 MB/s | 62 kB 00:00 2020-04-28T12:53:39.617 INFO:teuthology.orchestra.run.smithi026.stdout:(7/8): zlib-devel-1.2.11-10.el8.x86_64.rpm 24 MB/s | 56 kB 00:00 2020-04-28T12:53:39.620 INFO:teuthology.orchestra.run.smithi026.stdout:(8/8): libxml2-devel-2.9.7-5.el8.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2020-04-28T12:53:39.622 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2020-04-28T12:53:39.623 INFO:teuthology.orchestra.run.smithi026.stdout:Total 28 MB/s | 1.8 MB 00:00 2020-04-28T12:53:39.633 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2020-04-28T12:53:39.645 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2020-04-28T12:53:39.645 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2020-04-28T12:53:39.782 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2020-04-28T12:53:39.783 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2020-04-28T12:53:40.253 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2020-04-28T12:53:40.442 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:53:40.471 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgpg-error-devel-1.31-1.el8.x86_64 1/8 2020-04-28T12:53:40.659 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:53:40.672 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgcrypt-devel-1.8.3-4.el8.x86_64 2/8 2020-04-28T12:53:40.823 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 3/8 2020-04-28T12:53:40.984 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xz-devel-5.2.4-3.el8.x86_64 4/8 2020-04-28T12:53:41.406 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cmake-filesystem-3.11.4-3.el8.x86_64 5/8 2020-04-28T12:53:41.711 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libxml2-devel-2.9.7-5.el8.x86_64 6/8 2020-04-28T12:53:42.073 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libxslt-devel-1.1.32-3.el8.x86_64 7/8 2020-04-28T12:53:42.291 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:53:42.512 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libevent-devel-2.1.8-5.el8.x86_64 8/8 2020-04-28T12:53:42.512 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cmake-filesystem-3.11.4-3.el8.x86_64 1/8 2020-04-28T12:53:42.512 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libevent-devel-2.1.8-5.el8.x86_64 2/8 2020-04-28T12:53:42.512 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libxml2-devel-2.9.7-5.el8.x86_64 3/8 2020-04-28T12:53:42.513 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libxslt-devel-1.1.32-3.el8.x86_64 4/8 2020-04-28T12:53:42.513 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgcrypt-devel-1.8.3-4.el8.x86_64 5/8 2020-04-28T12:53:42.513 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgpg-error-devel-1.31-1.el8.x86_64 6/8 2020-04-28T12:53:42.513 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xz-devel-5.2.4-3.el8.x86_64 7/8 2020-04-28T12:53:42.881 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 8/8 2020-04-28T12:53:42.882 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:42.882 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2020-04-28T12:53:42.882 INFO:teuthology.orchestra.run.smithi026.stdout: libevent-devel-2.1.8-5.el8.x86_64 libxml2-devel-2.9.7-5.el8.x86_64 2020-04-28T12:53:42.883 INFO:teuthology.orchestra.run.smithi026.stdout: libxslt-devel-1.1.32-3.el8.x86_64 zlib-devel-1.2.11-10.el8.x86_64 2020-04-28T12:53:42.883 INFO:teuthology.orchestra.run.smithi026.stdout: cmake-filesystem-3.11.4-3.el8.x86_64 libgcrypt-devel-1.8.3-4.el8.x86_64 2020-04-28T12:53:42.883 INFO:teuthology.orchestra.run.smithi026.stdout: libgpg-error-devel-1.31-1.el8.x86_64 xz-devel-5.2.4-3.el8.x86_64 2020-04-28T12:53:42.883 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:42.883 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2020-04-28T12:53:44.454 INFO:teuthology.orchestra.run.smithi026.stdout:Using base prefix '/usr' 2020-04-28T12:53:44.454 INFO:teuthology.orchestra.run.smithi026.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python3 2020-04-28T12:53:44.454 INFO:teuthology.orchestra.run.smithi026.stdout:Also creating executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2020-04-28T12:53:47.437 INFO:teuthology.orchestra.run.smithi026.stdout:Installing setuptools, pip, wheel...done. 2020-04-28T12:53:47.445 INFO:teuthology.orchestra.run.smithi026.stdout:Running virtualenv with interpreter /usr/bin/python3 2020-04-28T12:53:48.037 INFO:teuthology.orchestra.run.smithi026.stdout:Requirement already up-to-date: pip in ./virtualenv/lib/python3.6/site-packages (20.0.2) 2020-04-28T12:53:48.823 INFO:teuthology.orchestra.run.smithi026.stdout:Requirement already satisfied: six in /usr/lib/python3.6/site-packages (1.11.0) 2020-04-28T12:53:49.510 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting nose 2020-04-28T12:53:49.569 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading nose-1.3.7-py3-none-any.whl (154 kB) 2020-04-28T12:53:49.762 INFO:teuthology.orchestra.run.smithi026.stdout:Installing collected packages: nose 2020-04-28T12:53:49.849 INFO:teuthology.orchestra.run.smithi026.stdout:Successfully installed nose-1.3.7 2020-04-28T12:53:50.319 INFO:teuthology.orchestra.run.smithi026.stdout:Requirement already satisfied: setuptools in ./virtualenv/lib/python3.6/site-packages (46.1.3) 2020-04-28T12:53:51.134 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting PyYAML 2020-04-28T12:53:51.179 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading PyYAML-5.3.1.tar.gz (269 kB) 2020-04-28T12:53:51.854 INFO:teuthology.orchestra.run.smithi026.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python3.6/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2020-04-28T12:53:51.952 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting boto!=2.46.0,>=2.6.0 2020-04-28T12:53:51.961 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading boto-2.49.0-py2.py3-none-any.whl (1.4 MB) 2020-04-28T12:53:52.332 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting munch>=1.0.0 2020-04-28T12:53:52.439 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading munch-2.5.0-py2.py3-none-any.whl (10 kB) 2020-04-28T12:53:52.647 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting gevent>=1.0 2020-04-28T12:53:52.661 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading gevent-20.4.0-cp36-cp36m-manylinux2010_x86_64.whl (5.1 MB) 2020-04-28T12:53:53.192 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting httplib2 2020-04-28T12:53:53.211 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading httplib2-0.17.3-py3-none-any.whl (95 kB) 2020-04-28T12:53:53.856 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting lxml 2020-04-28T12:53:53.865 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading lxml-4.5.0-cp36-cp36m-manylinux1_x86_64.whl (5.8 MB) 2020-04-28T12:53:54.245 INFO:teuthology.orchestra.run.smithi026.stdout:Requirement already satisfied, skipping upgrade: six in /usr/lib/python3.6/site-packages (from munch>=1.0.0->-r requirements.txt (line 4)) (1.11.0) 2020-04-28T12:53:54.369 INFO:teuthology.orchestra.run.smithi026.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2020-04-28T12:53:54.378 INFO:teuthology.orchestra.run.smithi026.stdout: Downloading greenlet-0.4.15-cp36-cp36m-manylinux1_x86_64.whl (41 kB) 2020-04-28T12:53:54.444 INFO:teuthology.orchestra.run.smithi026.stdout:Building wheels for collected packages: PyYAML 2020-04-28T12:53:54.444 INFO:teuthology.orchestra.run.smithi026.stdout: Building wheel for PyYAML (setup.py): started 2020-04-28T12:53:54.968 INFO:teuthology.orchestra.run.smithi026.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2020-04-28T12:53:54.969 INFO:teuthology.orchestra.run.smithi026.stdout: Created wheel for PyYAML: filename=PyYAML-5.3.1-cp36-cp36m-linux_x86_64.whl size=44621 sha256=78302e28218edbb408a0a4281f700824425a7e8940698d6b8401dd465578b803 2020-04-28T12:53:54.969 INFO:teuthology.orchestra.run.smithi026.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/e5/9d/ad/2ee53cf262cba1ffd8afe1487eef788ea3f260b7e6232a80fc 2020-04-28T12:53:54.969 INFO:teuthology.orchestra.run.smithi026.stdout:Successfully built PyYAML 2020-04-28T12:53:55.168 INFO:teuthology.orchestra.run.smithi026.stdout:Installing collected packages: PyYAML, boto, munch, greenlet, gevent, httplib2, lxml 2020-04-28T12:53:55.168 INFO:teuthology.orchestra.run.smithi026.stdout: Attempting uninstall: PyYAML 2020-04-28T12:53:55.168 INFO:teuthology.orchestra.run.smithi026.stdout: Found existing installation: PyYAML 3.12 2020-04-28T12:53:55.169 INFO:teuthology.orchestra.run.smithi026.stdout: Not uninstalling pyyaml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:53:55.169 INFO:teuthology.orchestra.run.smithi026.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2020-04-28T12:53:56.308 INFO:teuthology.orchestra.run.smithi026.stdout: Attempting uninstall: lxml 2020-04-28T12:53:56.309 INFO:teuthology.orchestra.run.smithi026.stdout: Found existing installation: lxml 4.2.3 2020-04-28T12:53:56.309 INFO:teuthology.orchestra.run.smithi026.stdout: Not uninstalling lxml at /usr/lib64/python3.6/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2020-04-28T12:53:56.309 INFO:teuthology.orchestra.run.smithi026.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2020-04-28T12:53:56.487 INFO:teuthology.orchestra.run.smithi026.stdout:Successfully installed PyYAML-5.3.1 boto-2.49.0 gevent-20.4.0 greenlet-0.4.15 httplib2-0.17.3 lxml-4.5.0 munch-2.5.0 2020-04-28T12:53:56.846 INFO:teuthology.orchestra.run.smithi026.stdout:running develop 2020-04-28T12:53:56.881 INFO:teuthology.orchestra.run.smithi026.stdout:running egg_info 2020-04-28T12:53:56.881 INFO:teuthology.orchestra.run.smithi026.stdout:creating ragweed.egg-info 2020-04-28T12:53:56.881 INFO:teuthology.orchestra.run.smithi026.stdout:writing ragweed.egg-info/PKG-INFO 2020-04-28T12:53:56.882 INFO:teuthology.orchestra.run.smithi026.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2020-04-28T12:53:56.882 INFO:teuthology.orchestra.run.smithi026.stdout:writing requirements to ragweed.egg-info/requires.txt 2020-04-28T12:53:56.882 INFO:teuthology.orchestra.run.smithi026.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2020-04-28T12:53:56.882 INFO:teuthology.orchestra.run.smithi026.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:53:56.893 INFO:teuthology.orchestra.run.smithi026.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:53:56.894 INFO:teuthology.orchestra.run.smithi026.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2020-04-28T12:53:56.896 INFO:teuthology.orchestra.run.smithi026.stdout:running build_ext 2020-04-28T12:53:56.896 INFO:teuthology.orchestra.run.smithi026.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/ragweed.egg-link (link to .) 2020-04-28T12:53:56.896 INFO:teuthology.orchestra.run.smithi026.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2020-04-28T12:53:56.897 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:56.897 INFO:teuthology.orchestra.run.smithi026.stdout:Installed /home/ubuntu/cephtest/ragweed 2020-04-28T12:53:56.898 INFO:teuthology.orchestra.run.smithi026.stdout:Processing dependencies for ragweed==0.0.1 2020-04-28T12:53:56.900 INFO:teuthology.orchestra.run.smithi026.stdout:Searching for isodate>=0.4.4 2020-04-28T12:53:56.900 INFO:teuthology.orchestra.run.smithi026.stdout:Reading https://pypi.org/simple/isodate/ 2020-04-28T12:53:56.950 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl#sha256=aa4d33c06640f5352aca96e4b81afd8ab3b47337cc12089822d6f322ac772c81 2020-04-28T12:53:57.009 INFO:teuthology.orchestra.run.smithi026.stdout:Best match: isodate 0.6.0 2020-04-28T12:53:57.010 INFO:teuthology.orchestra.run.smithi026.stdout:Processing isodate-0.6.0-py2.py3-none-any.whl 2020-04-28T12:53:57.010 INFO:teuthology.orchestra.run.smithi026.stdout:Installing isodate-0.6.0-py2.py3-none-any.whl to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:53:57.018 INFO:teuthology.orchestra.run.smithi026.stdout:Adding isodate 0.6.0 to easy-install.pth file 2020-04-28T12:53:57.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:57.019 INFO:teuthology.orchestra.run.smithi026.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages/isodate-0.6.0-py3.6.egg 2020-04-28T12:53:57.073 INFO:teuthology.orchestra.run.smithi026.stdout:Searching for gevent==20.4.0 2020-04-28T12:53:57.073 INFO:teuthology.orchestra.run.smithi026.stdout:Best match: gevent 20.4.0 2020-04-28T12:53:57.073 INFO:teuthology.orchestra.run.smithi026.stdout:Adding gevent 20.4.0 to easy-install.pth file 2020-04-28T12:53:57.073 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:57.074 INFO:teuthology.orchestra.run.smithi026.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:53:57.075 INFO:teuthology.orchestra.run.smithi026.stdout:Searching for munch==2.5.0 2020-04-28T12:53:57.075 INFO:teuthology.orchestra.run.smithi026.stdout:Best match: munch 2.5.0 2020-04-28T12:53:57.075 INFO:teuthology.orchestra.run.smithi026.stdout:Adding munch 2.5.0 to easy-install.pth file 2020-04-28T12:53:57.075 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:57.075 INFO:teuthology.orchestra.run.smithi026.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:53:57.075 INFO:teuthology.orchestra.run.smithi026.stdout:Searching for PyYAML==5.3.1 2020-04-28T12:53:57.075 INFO:teuthology.orchestra.run.smithi026.stdout:Best match: PyYAML 5.3.1 2020-04-28T12:53:57.076 INFO:teuthology.orchestra.run.smithi026.stdout:Adding PyYAML 5.3.1 to easy-install.pth file 2020-04-28T12:53:57.077 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:57.077 INFO:teuthology.orchestra.run.smithi026.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:53:57.077 INFO:teuthology.orchestra.run.smithi026.stdout:Searching for boto==2.49.0 2020-04-28T12:53:57.077 INFO:teuthology.orchestra.run.smithi026.stdout:Best match: boto 2.49.0 2020-04-28T12:53:57.077 INFO:teuthology.orchestra.run.smithi026.stdout:Adding boto 2.49.0 to easy-install.pth file 2020-04-28T12:53:57.077 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:57.077 INFO:teuthology.orchestra.run.smithi026.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:53:57.078 INFO:teuthology.orchestra.run.smithi026.stdout:Searching for six==1.11.0 2020-04-28T12:53:57.078 INFO:teuthology.orchestra.run.smithi026.stdout:Best match: six 1.11.0 2020-04-28T12:53:57.078 INFO:teuthology.orchestra.run.smithi026.stdout:Adding six 1.11.0 to easy-install.pth file 2020-04-28T12:53:57.079 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:57.079 INFO:teuthology.orchestra.run.smithi026.stdout:Using /usr/lib/python3.6/site-packages 2020-04-28T12:53:57.079 INFO:teuthology.orchestra.run.smithi026.stdout:Searching for greenlet==0.4.15 2020-04-28T12:53:57.079 INFO:teuthology.orchestra.run.smithi026.stdout:Best match: greenlet 0.4.15 2020-04-28T12:53:57.079 INFO:teuthology.orchestra.run.smithi026.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2020-04-28T12:53:57.079 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:53:57.080 INFO:teuthology.orchestra.run.smithi026.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python3.6/site-packages 2020-04-28T12:53:57.080 INFO:teuthology.orchestra.run.smithi026.stdout:Finished processing dependencies for ragweed==0.0.1 2020-04-28T12:53:57.098 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:57.112 INFO:teuthology.orchestra.run.smithi026:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2020-04-28T12:53:57.197 INFO:tasks.ragweed:Configuring boto... 2020-04-28T12:53:57.197 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:57.251 INFO:teuthology.orchestra.run.smithi026:> cat > /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:53:57.335 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:53:57.389 INFO:teuthology.orchestra.run.smithi026:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2020-04-28T12:54:01.623 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2020-04-28T12:54:03.035 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2020-04-28T12:54:04.371 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2020-04-28T12:54:05.744 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2020-04-28T12:54:10.713 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2020-04-28T12:54:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2020-04-28T12:54:16.119 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2020-04-28T12:54:20.222 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2020-04-28T12:54:23.691 INFO:teuthology.orchestra.run.smithi026.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2020-04-28T12:54:23.691 INFO:teuthology.orchestra.run.smithi026.stderr: 2020-04-28T12:54:23.691 INFO:teuthology.orchestra.run.smithi026.stderr:---------------------------------------------------------------------- 2020-04-28T12:54:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:Ran 9 tests in 26.004s 2020-04-28T12:54:23.692 INFO:teuthology.orchestra.run.smithi026.stderr: 2020-04-28T12:54:23.692 INFO:teuthology.orchestra.run.smithi026.stderr:OK 2020-04-28T12:54:23.720 INFO:tasks.ragweed:Cleaning up boto... 2020-04-28T12:54:23.721 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:54:23.739 INFO:teuthology.orchestra.run.smithi026:> rm /home/ubuntu/cephtest/boto.cfg 2020-04-28T12:54:23.793 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:54:23.847 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2020-04-28T12:54:23.930 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.926+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.932 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.928+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.933 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.928+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.933 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.928+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.928+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.929+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.929+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.934 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.930+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:23.950 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.944+0000 7fb797d0f180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:54:23.950 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.944+0000 7fb797d0f180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:54:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.944+0000 7fb797d0f180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:54:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.944+0000 7fb797d0f180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:54:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.944+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.945+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:23.951 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.945+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.945+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:54:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.945+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.946+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:23.952 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.946+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.956 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.946+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:54:23.956 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.946+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.956 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.946+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.956 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.946+0000 7fb797d0f180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:54:23.956 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.946+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.957 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.947+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.957 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.947+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.957 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.947+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:23.957 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.947+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.957 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.947+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:54:23.957 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.947+0000 7fb797d0f180 20 zonegroup default 2020-04-28T12:54:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.947+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.948+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.948+0000 7fb797d0f180 10 Cannot find current period zone using local zone 2020-04-28T12:54:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.948+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.948+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.948+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.949+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:23.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.949+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.949+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:54:23.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.949+0000 7fb797d0f180 20 zone default found 2020-04-28T12:54:23.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.949+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.949+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.949+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:23.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.950+0000 7fb785cf8700 0 -- 172.21.15.26:0/4095519029 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x5573925a9070 msgr2=0x5573925ab4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:23.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.950+0000 7fb797d0f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:23.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.950+0000 7fb797d0f180 20 started sync module instance, tier type = 2020-04-28T12:54:23.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.950+0000 7fb797d0f180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:54:23.965 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.961+0000 7fb797d0f180 20 add_watcher() i=0 2020-04-28T12:54:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.961+0000 7fb797d0f180 20 add_watcher() i=1 2020-04-28T12:54:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.961+0000 7fb797d0f180 20 add_watcher() i=2 2020-04-28T12:54:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.961+0000 7fb797d0f180 20 add_watcher() i=3 2020-04-28T12:54:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.961+0000 7fb797d0f180 20 add_watcher() i=4 2020-04-28T12:54:23.966 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.961+0000 7fb797d0f180 20 add_watcher() i=5 2020-04-28T12:54:23.967 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.961+0000 7fb797d0f180 20 add_watcher() i=6 2020-04-28T12:54:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.962+0000 7fb797d0f180 20 add_watcher() i=7 2020-04-28T12:54:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.962+0000 7fb797d0f180 2 all 8 watchers are set, enabling cache 2020-04-28T12:54:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.962+0000 7fb797d0f180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:23.968 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.962+0000 7fb797d0f180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:23.969 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.962+0000 7fb7567dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:23.969 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:23.963+0000 7fb7864f9700 0 -- 172.21.15.26:0/2998253901 >> v2:172.21.15.26:3300/0 conn(0x5573925c8510 msgr2=0x5573925c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:54:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.012+0000 7fb6ccff9700 20 reqs_thread_entry: start 2020-04-28T12:54:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.012+0000 7fb6c67fc700 20 reqs_thread_entry: start 2020-04-28T12:54:24.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.012+0000 7fb797d0f180 20 init_complete bucket index max shards: 1999 2020-04-28T12:54:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.013+0000 7fb6c4ff9700 20 reqs_thread_entry: start 2020-04-28T12:54:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.013+0000 7fb797d0f180 20 get_system_obj_state: rctx=0x7ffd0a9149f8 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x557392473170 s->prefetch_data=0 2020-04-28T12:54:24.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.013+0000 7fb797d0f180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2020-04-28T12:54:24.021 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2020-04-28T12:54:24.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:54:24.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:24.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:24.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:54:24.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:54:24.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2020-04-28T12:54:24.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.014+0000 7fb797d0f180 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2020-04-28T12:54:24.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.015+0000 7fb797d0f180 10 removing key index: RJNLUHOVUMUQFQRZIYBF 2020-04-28T12:54:24.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.015+0000 7fb797d0f180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=170 2020-04-28T12:54:24.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.015+0000 7fb766ffd700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 93954865011936 notifier 4496 bl.length()=170 2020-04-28T12:54:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.017+0000 7fb797d0f180 10 removing email index: sysuser.client.0+test@test.test 2020-04-28T12:54:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.017+0000 7fb797d0f180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2020-04-28T12:54:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.018+0000 7fb766ffd700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 93954865072816 notifier 4496 bl.length()=182 2020-04-28T12:54:24.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.020+0000 7fb797d0f180 10 removing user buckets index 2020-04-28T12:54:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.020+0000 7fb797d0f180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2020-04-28T12:54:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.020+0000 7fb766ffd700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 93954865016592 notifier 4496 bl.length()=173 2020-04-28T12:54:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.022+0000 7fb797d0f180 10 removing user index: sysuser.client.0 2020-04-28T12:54:24.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.022+0000 7fb797d0f180 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2020-04-28T12:54:24.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.022+0000 7fb797d0f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2020-04-28T12:54:24.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.023+0000 7fb766ffd700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 93954865014752 notifier 4496 bl.length()=165 2020-04-28T12:54:24.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.025+0000 7fb7567dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:24.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.026+0000 7fb797d0f180 20 remove_watcher() i=0 2020-04-28T12:54:24.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.026+0000 7fb797d0f180 2 removed watcher, disabling cache 2020-04-28T12:54:24.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.028+0000 7fb797d0f180 20 remove_watcher() i=1 2020-04-28T12:54:24.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.029+0000 7fb797d0f180 20 remove_watcher() i=2 2020-04-28T12:54:24.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.030+0000 7fb797d0f180 20 remove_watcher() i=3 2020-04-28T12:54:24.036 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.032+0000 7fb797d0f180 20 remove_watcher() i=4 2020-04-28T12:54:24.038 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.033+0000 7fb797d0f180 20 remove_watcher() i=5 2020-04-28T12:54:24.038 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.034+0000 7fb797d0f180 20 remove_watcher() i=6 2020-04-28T12:54:24.040 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.035+0000 7fb797d0f180 20 remove_watcher() i=7 2020-04-28T12:54:24.044 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:54:24.099 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2020-04-28T12:54:24.182 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.177+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.179+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.179+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.180+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.184 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.180+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.180+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.180+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.181+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.195+0000 7fa3a385f180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:54:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.195+0000 7fa3a385f180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:54:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.195+0000 7fa3a385f180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:54:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.195+0000 7fa3a385f180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:54:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.195+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.196+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.196+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.196+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:54:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.196+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.197+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.197+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.197+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:54:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.197+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.198+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.198+0000 7fa3a385f180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:54:24.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.198+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.198+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.198+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.198+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.198+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:54:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 20 zonegroup default 2020-04-28T12:54:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 10 Cannot find current period zone using local zone 2020-04-28T12:54:24.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.199+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.200+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:54:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.200+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.200+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:54:24.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.200+0000 7fa3a385f180 20 zone default found 2020-04-28T12:54:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.200+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.201+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa38403d940 msgr2=0x7fa38403dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.201+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.201+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.201+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:24.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.201+0000 7fa3a385f180 20 started sync module instance, tier type = 2020-04-28T12:54:24.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.201+0000 7fa3a385f180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:54:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.212+0000 7fa3a385f180 20 add_watcher() i=0 2020-04-28T12:54:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.212+0000 7fa3a385f180 20 add_watcher() i=1 2020-04-28T12:54:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.212+0000 7fa3a385f180 20 add_watcher() i=2 2020-04-28T12:54:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.212+0000 7fa3a385f180 20 add_watcher() i=3 2020-04-28T12:54:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.212+0000 7fa3a385f180 20 add_watcher() i=4 2020-04-28T12:54:24.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.212+0000 7fa3a385f180 20 add_watcher() i=5 2020-04-28T12:54:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.212+0000 7fa3a385f180 20 add_watcher() i=6 2020-04-28T12:54:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.213+0000 7fa3a385f180 20 add_watcher() i=7 2020-04-28T12:54:24.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.213+0000 7fa3a385f180 2 all 8 watchers are set, enabling cache 2020-04-28T12:54:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.213+0000 7fa3a385f180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:54:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.213+0000 7fa3a385f180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:54:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.214+0000 7fa3627dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:24.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.214+0000 7fa38bfff700 0 -- 172.21.15.26:0/1538274281 >> v1:172.21.15.26:6789/0 conn(0x55c326483ac0 legacy=0x55c32648a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2020-04-28T12:54:24.269 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.264+0000 7fa2d8ff9700 20 reqs_thread_entry: start 2020-04-28T12:54:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.264+0000 7fa2d27fc700 20 reqs_thread_entry: start 2020-04-28T12:54:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.264+0000 7fa3a385f180 20 init_complete bucket index max shards: 1999 2020-04-28T12:54:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa2d0ff9700 20 reqs_thread_entry: start 2020-04-28T12:54:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad5488 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:24.270 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2020-04-28T12:54:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2020-04-28T12:54:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:54:24.271 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2020-04-28T12:54:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.265+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.266+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=448 2020-04-28T12:54:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.266+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2020-04-28T12:54:24.272 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.266+0000 7fa3a385f180 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2020-04-28T12:54:24.273 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-conf state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:24.273 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2020-04-28T12:54:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2020-04-28T12:54:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:54:24.274 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=200 2020-04-28T12:54:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2020-04-28T12:54:24.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.267+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:54:24.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:24.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 : miss 2020-04-28T12:54:24.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 info.flags=0x16 2020-04-28T12:54:24.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 to cache LRU end 2020-04-28T12:54:24.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:24.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.268+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:24.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.269+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=293 2020-04-28T12:54:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.269+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 info.flags=0x13 2020-04-28T12:54:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.269+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 to cache LRU end 2020-04-28T12:54:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.269+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.269+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:24.278 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.269+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 2020-04-28T12:54:24.396 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.391+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-conf[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1]) start_after [] num_entries 1100 2020-04-28T12:54:24.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.473+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2020-04-28T12:54:24.504 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.500+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2020-04-28T12:54:24.629 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.625+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37c00c5f0 msgr2=0x7fa374064080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:24.639 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.634+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37405ca00 msgr2=0x7fa37405ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:24.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.639+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x55c326463050 msgr2=0x55c3264654a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:24.762 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.757+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa38c010ab0 msgr2=0x7fa38c007930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:24.954 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.949+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2020-04-28T12:54:24.963 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:24.958+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2020-04-28T12:54:25.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.013+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2020-04-28T12:54:25.115 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.110+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2020-04-28T12:54:25.133 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.129+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2020-04-28T12:54:25.246 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.241+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2020-04-28T12:54:25.297 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.293+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2020-04-28T12:54:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.368+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c3266032d8 s->prefetch_data=0 2020-04-28T12:54:25.374 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.369+0000 7fa3a385f180 10 manifest: total_size = 7296 2020-04-28T12:54:25.374 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.369+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.56 2020-04-28T12:54:25.374 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.369+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55c3266032d8 s->prefetch_data=0 2020-04-28T12:54:25.375 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.369+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3266032d8 2020-04-28T12:54:25.375 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.369+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.162 2020-04-28T12:54:25.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.372+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : miss 2020-04-28T12:54:25.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.372+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : miss 2020-04-28T12:54:25.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.373+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.374+0000 7fa3a385f180 10 manifest: total_size = 12968 2020-04-28T12:54:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.374+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.30 2020-04-28T12:54:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.374+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.374+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c32661bb28 2020-04-28T12:54:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.374+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.215 2020-04-28T12:54:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.377+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.377+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.377+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.377+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.377+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.377+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.377+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 10 manifest: total_size = 4864 2020-04-28T12:54:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.13 2020-04-28T12:54:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c32661bb28 2020-04-28T12:54:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.378+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.1143 2020-04-28T12:54:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.381+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.381+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.382+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.383+0000 7fa3a385f180 10 manifest: total_size = 7723 2020-04-28T12:54:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.383+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.246 2020-04-28T12:54:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.383+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.383+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c32661bb28 2020-04-28T12:54:25.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.383+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.1162 2020-04-28T12:54:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.386+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.386+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.386+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.386+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.386+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.386+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.386+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 10 manifest: total_size = 7656 2020-04-28T12:54:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.120 2020-04-28T12:54:25.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55c32661bb28 s->prefetch_data=0 2020-04-28T12:54:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c32661bb28 2020-04-28T12:54:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.387+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.1273 2020-04-28T12:54:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.391+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.395 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.391+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.391+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.391+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.391+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.397 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.391+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.391+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.398 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 10 manifest: total_size = 7682 2020-04-28T12:54:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.189 2020-04-28T12:54:25.399 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3266c97e8 2020-04-28T12:54:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.392+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.1462 2020-04-28T12:54:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.395+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.395+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.396+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.397+0000 7fa3a385f180 10 manifest: total_size = 12695 2020-04-28T12:54:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.397+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.72 2020-04-28T12:54:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.397+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.397+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3266c97e8 2020-04-28T12:54:25.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.397+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.1499 2020-04-28T12:54:25.405 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.400+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.405 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.400+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.405 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.406 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.406 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.406 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.406 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.407 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.407 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.408 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.408 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.408 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.401+0000 7fa3a385f180 10 manifest: total_size = 5009 2020-04-28T12:54:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.402+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.322 2020-04-28T12:54:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.402+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.402+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3266c97e8 2020-04-28T12:54:25.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.402+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.1735 2020-04-28T12:54:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.405+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.406+0000 7fa3a385f180 10 manifest: total_size = 7424 2020-04-28T12:54:25.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.406+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.87 2020-04-28T12:54:25.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.406+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55c3266c97e8 s->prefetch_data=0 2020-04-28T12:54:25.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.406+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3266c97e8 2020-04-28T12:54:25.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.406+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1.1841 2020-04-28T12:54:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.409+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.409+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-conf info.flags=0x0 2020-04-28T12:54:25.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-conf to cache LRU end 2020-04-28T12:54:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.410+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-conf[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:25.417 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.411+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:25.427 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.422+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x55c3264670a0 msgr2=0x7fa374064b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.500+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x55c3264670a0 msgr2=0x7fa374064b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:25.534 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.529+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37405ca00 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:25.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.534+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:25.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.534+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:25.540 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.535+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:25.540 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.535+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:25.571 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.566+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x55c326463050 msgr2=0x7fa3740617e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:25.646 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.642+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37c00c5f0 msgr2=0x7fa37406f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:25.661 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.656+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-conf state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:25.662 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.656+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:25.662 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2020-04-28T12:54:25.662 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2020-04-28T12:54:25.662 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:25.662 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:25.663 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:25.663 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-conf from cache 2020-04-28T12:54:25.663 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2020-04-28T12:54:25.664 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.657+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94296647723968 notifier 4914 bl.length()=162 2020-04-28T12:54:25.664 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.660+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.1 from cache 2020-04-28T12:54:25.664 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.660+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=219 2020-04-28T12:54:25.665 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:25.660+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94296649184720 notifier 4914 bl.length()=219 2020-04-28T12:54:26.066 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.061+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:26.066 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.061+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:54:26.067 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.062+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2020-04-28T12:54:26.067 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.062+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:54:26.067 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.062+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:26.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.062+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:26.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.062+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:26.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.062+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:26.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=229 2020-04-28T12:54:26.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2020-04-28T12:54:26.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:54:26.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 : miss 2020-04-28T12:54:26.069 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 info.flags=0x16 2020-04-28T12:54:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 to cache LRU end 2020-04-28T12:54:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:26.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:26.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.063+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:26.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.064+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=322 2020-04-28T12:54:26.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.064+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 info.flags=0x13 2020-04-28T12:54:26.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.064+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 to cache LRU end 2020-04-28T12:54:26.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.064+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:26.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.064+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:26.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.064+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 2020-04-28T12:54:26.127 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.123+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x55c3264670a0 msgr2=0x7fa374064b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:26.180 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.175+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2]) start_after [] num_entries 1100 2020-04-28T12:54:26.517 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.509+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa38c010ab0 msgr2=0x7fa374063f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.631+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa38403d940 msgr2=0x7fa374061330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:26.774 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:26.770+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:54:27.164 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.159+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c326684a58 s->prefetch_data=0 2020-04-28T12:54:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.160+0000 7fa3a385f180 10 manifest: total_size = 1848 2020-04-28T12:54:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.160+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.20 2020-04-28T12:54:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.160+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55c326684a58 s->prefetch_data=0 2020-04-28T12:54:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.160+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326684a58 2020-04-28T12:54:27.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.160+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2.1201 2020-04-28T12:54:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.163+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:54:27.168 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.163+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:27.169 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:27.169 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:54:27.169 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:54:27.169 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 : miss 2020-04-28T12:54:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 info.flags=0x0 2020-04-28T12:54:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:54:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:27.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:54:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=515 2020-04-28T12:54:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2020-04-28T12:54:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:54:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291971 part_ofs=515 rule->part_size=515 2020-04-28T12:54:27.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2020-04-28T12:54:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:54:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6292486 part_ofs=1030 rule->part_size=515 2020-04-28T12:54:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2020-04-28T12:54:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2020-04-28T12:54:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6293001 part_ofs=1545 rule->part_size=303 2020-04-28T12:54:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2020-04-28T12:54:27.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.164+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.20 2020-04-28T12:54:27.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.166+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:27.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.166+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-complete.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:27.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.166+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:27.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.234+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa374064b20 msgr2=0x7fa374073f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.236+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa38403d940 msgr2=0x7fa3740612a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.243 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.239+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37c00c5f0 msgr2=0x7fa37406f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.282+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa374063f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.302 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.297+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:27.302 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.297+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:27.302 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.297+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:27.302 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.297+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:27.325 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.320+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x55c32645fa30 msgr2=0x7fa374069040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.330 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.326+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa374076b80 msgr2=0x7fa374072b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.372 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.367+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x55c32645fa30 msgr2=0x7fa374068f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.376+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa3740617e0 msgr2=0x7fa374072fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.381 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.376+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa38403d940 msgr2=0x7fa3740612a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.384+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa3740617e0 msgr2=0x7fa374072fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.386+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa374076b80 msgr2=0x7fa374072b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2020-04-28T12:54:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2020-04-28T12:54:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2020-04-28T12:54:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.407+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2020-04-28T12:54:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.408+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94296649175184 notifier 4914 bl.length()=191 2020-04-28T12:54:27.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.410+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2 from cache 2020-04-28T12:54:27.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.410+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=248 2020-04-28T12:54:27.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.410+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94296649191472 notifier 4914 bl.length()=248 2020-04-28T12:54:27.474 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.470+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37406f070 msgr2=0x7fa374063f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.632+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa374076b80 msgr2=0x7fa374072b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:27.778 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.773+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37406f070 msgr2=0x7fa374073860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:27.813 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:54:27.814 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2020-04-28T12:54:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:54:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.809+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:27.815 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=236 2020-04-28T12:54:27.816 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2020-04-28T12:54:27.816 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:54:27.816 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:27.816 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 : miss 2020-04-28T12:54:27.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 info.flags=0x16 2020-04-28T12:54:27.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 to cache LRU end 2020-04-28T12:54:27.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:27.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:27.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:27.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:27.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:27.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:27.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.810+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.811+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=329 2020-04-28T12:54:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.811+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 info.flags=0x13 2020-04-28T12:54:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.811+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 to cache LRU end 2020-04-28T12:54:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.811+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.811+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.811+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 2020-04-28T12:54:27.861 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.857+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa3740617e0 msgr2=0x7fa374072fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.859+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x55c32645fa30 msgr2=0x7fa374068f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.896 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.891+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa38403e7d0 msgr2=0x7fa3740646c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:27.925 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.920+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa374077350 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:27.930+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3]) start_after [] num_entries 1100 2020-04-28T12:54:28.492 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.488+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa374064b20 msgr2=0x7fa374073f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:28.523 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.518+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:54:28.807 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.803+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa38403d940 msgr2=0x7fa3740612a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:28.838 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.834+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37c010a60 msgr2=0x7fa374073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:28.913 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.909+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c3266a2a68 s->prefetch_data=0 2020-04-28T12:54:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.909+0000 7fa3a385f180 10 manifest: total_size = 886297 2020-04-28T12:54:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.909+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.40 2020-04-28T12:54:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.909+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55c3266a2a68 s->prefetch_data=0 2020-04-28T12:54:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.909+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3266a2a68 2020-04-28T12:54:28.914 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.909+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3.1201 2020-04-28T12:54:28.917 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.912+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:54:28.917 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.912+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:28.918 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:54:28.919 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:54:28.919 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 : miss 2020-04-28T12:54:28.919 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:28.919 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:28.919 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x0 2020-04-28T12:54:28.920 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:54:28.920 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:28.920 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:28.920 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:28.920 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:54:28.920 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:54:28.921 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:54:28.921 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:54:28.921 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:54:28.921 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2020-04-28T12:54:28.921 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:54:28.921 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2020-04-28T12:54:28.921 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2020-04-28T12:54:28.922 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2020-04-28T12:54:28.922 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2020-04-28T12:54:28.922 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2020-04-28T12:54:28.922 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.913+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.40 2020-04-28T12:54:28.923 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.915+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:28.923 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.915+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-defer-update-complete.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:28.923 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.916+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:28.945 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.940+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x55c32645fa30 msgr2=0x7fa374068f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:28.984 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:28.979+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa38403d940 msgr2=0x7fa374074120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.026+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.026+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.026+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.026+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:29.061 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.057+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa374076b80 msgr2=0x7fa374072b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.067+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x55c32645fa30 msgr2=0x7fa374073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.074+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa38403d940 msgr2=0x7fa374074120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.080 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.075+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa3740617e0 msgr2=0x7fa374072fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.111 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.106+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa374077350 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.142 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.137+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:29.142 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.137+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2020-04-28T12:54:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2020-04-28T12:54:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:29.143 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:29.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:29.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2020-04-28T12:54:29.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2020-04-28T12:54:29.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.138+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94296649184720 notifier 4914 bl.length()=198 2020-04-28T12:54:29.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.140+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3 from cache 2020-04-28T12:54:29.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.140+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=255 2020-04-28T12:54:29.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.141+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94296649190592 notifier 4914 bl.length()=255 2020-04-28T12:54:29.182 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.178+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa374076f60 msgr2=0x7fa374073cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:29.417 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.412+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa374074120 msgr2=0x7fa374072ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:54:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2020-04-28T12:54:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:54:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.527+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=231 2020-04-28T12:54:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2020-04-28T12:54:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:54:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 : miss 2020-04-28T12:54:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 info.flags=0x16 2020-04-28T12:54:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 to cache LRU end 2020-04-28T12:54:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.528+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.529+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=324 2020-04-28T12:54:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.529+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 info.flags=0x13 2020-04-28T12:54:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.529+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 to cache LRU end 2020-04-28T12:54:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.529+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.529+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:29.540 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.529+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 2020-04-28T12:54:29.552 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.547+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa374064010 msgr2=0x7fa37406b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.552 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.548+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37c010a60 msgr2=0x7fa3740612a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.576 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.571+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37c010a60 msgr2=0x7fa374061260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.609+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa3740637f0 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:29.655 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:29.645+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4]) start_after [] num_entries 1100 2020-04-28T12:54:30.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.141+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa374071d30 msgr2=0x7fa374072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:30.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.234+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo[UuyI5ncs-1YipdCNlyzKOoYDWRTu4NN] 2020-04-28T12:54:30.304 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.300+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407d600 msgr2=0x7fa37406f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:30.351 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.346+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa374074120 msgr2=0x7fa374072ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:30.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.375+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa374073cc0 msgr2=0x7fa37407e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:30.628 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.624+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.624+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55c3266dfae8 s->prefetch_data=0 2020-04-28T12:54:30.629 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.625+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to bkcj4fzqci8agmcmhxt23xcuzozrmr04 2020-04-28T12:54:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.625+0000 7fa3a385f180 20 get_obj_state_impl: setting s->olh_tag to repr15zth6uypgpxocnda84uz3syu1uy 2020-04-28T12:54:30.630 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.625+0000 7fa3a385f180 20 bucket_index_guard_olh_op(): olh_state.olh_tag=repr15zth6uypgpxocnda84uz3syu1uy 2020-04-28T12:54:30.631 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.627+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.628+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.628+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 20 olh_log_entry: epoch=3 op=2 key=[] 2020-04-28T12:54:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 20 olh_log_entry: epoch=3 op=3 key=foo[UuyI5ncs-1YipdCNlyzKOoYDWRTu4NN] 2020-04-28T12:54:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-index-versioning.1:_:UuyI5ncs-1YipdCNlyzKOoYDWRTu4NN_foo state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 10 manifest: total_size = 1848 2020-04-28T12:54:30.634 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.55 2020-04-28T12:54:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-index-versioning.1:_:UuyI5ncs-1YipdCNlyzKOoYDWRTu4NN_foo state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:30.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.629+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.632+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:54:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.632+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:54:30.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:54:30.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : miss 2020-04-28T12:54:30.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:30.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:30.640 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:54:30.640 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:54:30.640 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:30.640 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:30.642 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:30.642 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:54:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=515 2020-04-28T12:54:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2020-04-28T12:54:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:54:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291971 part_ofs=515 rule->part_size=515 2020-04-28T12:54:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2020-04-28T12:54:30.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2020-04-28T12:54:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6292486 part_ofs=1030 rule->part_size=515 2020-04-28T12:54:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2020-04-28T12:54:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2020-04-28T12:54:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6293001 part_ofs=1545 rule->part_size=303 2020-04-28T12:54:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2020-04-28T12:54:30.644 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.633+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.55 2020-04-28T12:54:30.645 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.637+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.645 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.637+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.645 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.640+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.646 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4.1201 2020-04-28T12:54:30.647 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:30.647 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:54:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:54:30.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.642+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 info.flags=0x0 2020-04-28T12:54:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:54:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:30.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:30.650 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:30.650 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-index-versioning.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:30.650 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.643+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.698+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa3740637f0 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:30.718 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.712+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37406f070 msgr2=0x7fa374073860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.754+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:30.763 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.754+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.755+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:30.764 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.755+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:30.771 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.767+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa374074120 msgr2=0x7fa374064640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:30.786 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.781+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa374071d30 msgr2=0x7fa374072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:30.804 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.800+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37406f070 msgr2=0x7fa374073860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:30.807 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.803+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x55c32645fa30 msgr2=0x7fa374073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:30.854 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.849+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa374064010 msgr2=0x7fa37406b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:30.871 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.866+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407e4b0 msgr2=0x7fa374064640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.870+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:30.875 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.870+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2020-04-28T12:54:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2020-04-28T12:54:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2020-04-28T12:54:30.877 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2020-04-28T12:54:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.871+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94296649184720 notifier 4914 bl.length()=193 2020-04-28T12:54:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.873+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4 from cache 2020-04-28T12:54:30.878 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.873+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=250 2020-04-28T12:54:30.879 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.874+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94296649192224 notifier 4914 bl.length()=250 2020-04-28T12:54:30.943 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:30.938+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407e0d0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:31.137 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.132+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa3740637f0 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.139+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407e0d0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.210+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37407d600 msgr2=0x7fa374061260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.256+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:31.261 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.256+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:54:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.257+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2020-04-28T12:54:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.257+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:54:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.257+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.257+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.257+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:31.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.257+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.258+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:54:31.263 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.258+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2020-04-28T12:54:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.258+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:54:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.258+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.258+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 : miss 2020-04-28T12:54:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 info.flags=0x16 2020-04-28T12:54:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 to cache LRU end 2020-04-28T12:54:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:31.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:31.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:31.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:31.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:31.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:31.265 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:54:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 info.flags=0x13 2020-04-28T12:54:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 to cache LRU end 2020-04-28T12:54:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:31.266 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:31.267 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.259+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 2020-04-28T12:54:31.305 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.301+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa374071d30 msgr2=0x7fa374072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.329+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa37407d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.338 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.333+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa374073cc0 msgr2=0x7fa37406ebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.341 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.336+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407d600 msgr2=0x7fa374061260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.341+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37406f070 msgr2=0x7fa37407bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:31.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.382+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5]) start_after [] num_entries 1100 2020-04-28T12:54:31.493 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.488+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x55c32645fa30 msgr2=0x7fa37407cd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.495+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa3740637f0 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:31.569 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.564+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37406e440 msgr2=0x7fa37406eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:31.601 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.596+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407e0d0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.701 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.693+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa374071d30 msgr2=0x7fa37407d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.809 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.804+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407e0d0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.824 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.820+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa3740637f0 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:31.829 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.825+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37406e440 msgr2=0x7fa37406e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:31.970 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:31.965+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo[] 2020-04-28T12:54:32.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.379+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:32.384 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.379+0000 7fa3a385f180 10 manifest: total_size = 886297 2020-04-28T12:54:32.384 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.379+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.71 2020-04-28T12:54:32.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.379+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:32.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.379+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:32.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.379+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5.1201 2020-04-28T12:54:32.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.383+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:54:32.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.383+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:32.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:32.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:54:32.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:54:32.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 : miss 2020-04-28T12:54:32.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 info.flags=0x0 2020-04-28T12:54:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:54:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:54:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2020-04-28T12:54:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2020-04-28T12:54:32.391 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:54:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2020-04-28T12:54:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2020-04-28T12:54:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2020-04-28T12:54:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2020-04-28T12:54:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2020-04-28T12:54:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2020-04-28T12:54:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2020-04-28T12:54:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2020-04-28T12:54:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.384+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.71 2020-04-28T12:54:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.386+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.386+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-multipart-simple.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:32.394 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.386+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.401+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407e4b0 msgr2=0x7fa374064640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.423 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.419+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37406f070 msgr2=0x7fa37407bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.433 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.429+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa3740637f0 msgr2=0x7fa37405edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.456 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.451+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x55c32645fa30 msgr2=0x7fa374072990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.476 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.471+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37406e440 msgr2=0x7fa37406e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.498 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.494+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37407e4b0 msgr2=0x7fa374064640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.508+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.508+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.508+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.508+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:32.529 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.524+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa374071d30 msgr2=0x7fa37407d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.543 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.536+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa37407b9e0 msgr2=0x7fa37406b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.606 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.602+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407e0d0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:32.816 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.811+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:32.816 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.811+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:32.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2020-04-28T12:54:32.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2020-04-28T12:54:32.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:32.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:32.817 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:32.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2020-04-28T12:54:32.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2020-04-28T12:54:32.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.812+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94296649190592 notifier 4914 bl.length()=183 2020-04-28T12:54:32.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.814+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5 from cache 2020-04-28T12:54:32.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.814+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=240 2020-04-28T12:54:32.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.815+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879303 cookie 94296647723968 notifier 4914 bl.length()=240 2020-04-28T12:54:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:32.912+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37407b0f0 msgr2=0x7fa37406d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:33.063 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.058+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x55c32645fa30 msgr2=0x7fa37407c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:33.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.211+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:33.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.211+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:54:33.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2020-04-28T12:54:33.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:33.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:33.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:33.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:33.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:33.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=227 2020-04-28T12:54:33.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2020-04-28T12:54:33.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:33.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:33.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.212+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 : miss 2020-04-28T12:54:33.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 info.flags=0x16 2020-04-28T12:54:33.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 to cache LRU end 2020-04-28T12:54:33.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:33.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:33.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:33.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:33.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:33.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.213+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.214+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=320 2020-04-28T12:54:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.214+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 info.flags=0x13 2020-04-28T12:54:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.214+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 to cache LRU end 2020-04-28T12:54:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.214+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.214+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.214+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 2020-04-28T12:54:33.261 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.256+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37406f070 msgr2=0x7fa37407bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.288+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa374064640 msgr2=0x7fa37406b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:33.302 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.297+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37407d600 msgr2=0x7fa374061260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:33.342 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.337+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7]) start_after [] num_entries 1100 2020-04-28T12:54:33.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.401+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:54:33.432 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.428+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:54:33.437 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.432+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:54:33.561 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.556+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407d600 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:33.596 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.586+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:54:33.651 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.647+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:54:33.666 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.661+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa37407bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:33.821 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.816+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:54:33.883 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.878+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x55c32645fa30 msgr2=0x7fa37407c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:33.891 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.887+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407d600 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:33.898 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.894+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:54:33.916 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:33.911+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:54:34.046 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.042+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:54:34.055 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.050+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:54:34.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.147+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:54:34.159 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.155+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa37407bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.163+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:54:34.234 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.229+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x55c32645fa30 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.328 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.323+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c32658a028 s->prefetch_data=0 2020-04-28T12:54:34.329 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.324+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.329 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.324+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.112 2020-04-28T12:54:34.329 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.324+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55c32658a028 s->prefetch_data=0 2020-04-28T12:54:34.329 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.324+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c32658a028 2020-04-28T12:54:34.329 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.324+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.126 2020-04-28T12:54:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.327+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:54:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.327+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : miss 2020-04-28T12:54:34.334 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.334 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.334 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.334 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.328+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.334 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.329+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.334 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.329+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.329+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.329+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.329+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.329+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.112 2020-04-28T12:54:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.330+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.330+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.330+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.114 2020-04-28T12:54:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.330+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.330+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.330+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.182 2020-04-28T12:54:34.338 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.334+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.338 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.334+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.339 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.334+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.339 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.334+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.339 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.334+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.340 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.334+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.340 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.334+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.340 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.340 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.340 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.340 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.335+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.114 2020-04-28T12:54:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.336+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.337+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.337+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _HgmXlmFU_qBnjVRDhQffrQf0Y0hReNO 2020-04-28T12:54:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.337+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.337+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.337+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.192 2020-04-28T12:54:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.339+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.339+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.340+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _HgmXlmFU_qBnjVRDhQffrQf0Y0hReNO 2020-04-28T12:54:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.342+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.343+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.343+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.108 2020-04-28T12:54:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.343+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.343+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.350 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.343+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.501 2020-04-28T12:54:34.350 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.346+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.350 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.346+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.346+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.351 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.346+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.346+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.346+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.346+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.352 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.353 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.347+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.108 2020-04-28T12:54:34.354 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.348+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.354 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.349+0000 7fa3a385f180 10 manifest: total_size = 324647 2020-04-28T12:54:34.354 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.349+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _m9kI8Yk40rSfDe6djkC_vbVlXfm4WGM 2020-04-28T12:54:34.354 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.349+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.349+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.355 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.349+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.625 2020-04-28T12:54:34.358 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.352+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.358 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.352+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.358 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.352+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.352+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.352+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.352+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.352+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.359 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.360 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.353+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _m9kI8Yk40rSfDe6djkC_vbVlXfm4WGM 2020-04-28T12:54:34.361 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.354+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.361 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.355+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.361 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.355+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _j3aJpd96Wv1GD7fmo38IMvhRfYv1FtE 2020-04-28T12:54:34.361 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.355+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.362 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.355+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.362 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.355+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.965 2020-04-28T12:54:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.358+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.358+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.369 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.370 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.360+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _j3aJpd96Wv1GD7fmo38IMvhRfYv1FtE 2020-04-28T12:54:34.371 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.362+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.372 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.362+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.372 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.362+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _CSyXtMorh7v9QyeBYVWgMF2gGomSyut 2020-04-28T12:54:34.373 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.362+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.373 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.362+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.373 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.362+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.1116 2020-04-28T12:54:34.375 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.366+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.375 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.366+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.375 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.376 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.376 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.376 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.376 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.376 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.376 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.367+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _CSyXtMorh7v9QyeBYVWgMF2gGomSyut 2020-04-28T12:54:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.369+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.369+0000 7fa3a385f180 10 manifest: total_size = 324647 2020-04-28T12:54:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.369+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _vLwEJCUmC8warFeGQQTTp5fJKyKuSY1 2020-04-28T12:54:34.378 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.369+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.369+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.369+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.1151 2020-04-28T12:54:34.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.372+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.372+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.380 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.381 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.382 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.373+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.374+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.374+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _j-omdDU0GfnkU7snRIrxMIB6z_5cmu7 2020-04-28T12:54:34.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.374+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.374+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.383 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.374+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.1419 2020-04-28T12:54:34.385 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.377+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.377+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.377+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.377+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.377+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.377+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.377+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.387 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.378+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _j-omdDU0GfnkU7snRIrxMIB6z_5cmu7 2020-04-28T12:54:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.379+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.388 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.380+0000 7fa3a385f180 10 manifest: total_size = 324647 2020-04-28T12:54:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.380+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.116 2020-04-28T12:54:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.380+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.389 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.380+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.397 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.380+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.1438 2020-04-28T12:54:34.399 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.384+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.384+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.384+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.384+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.384+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.384+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.384+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.401 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 10 manifest: total_size = 324647 2020-04-28T12:54:34.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _PCWjuZdeOaovfmz8uLk6tfkmRgSdeHU 2020-04-28T12:54:34.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.385+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.1634 2020-04-28T12:54:34.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.389+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.402 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.389+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.389+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.389+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.389+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.389+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.389+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.404 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.409 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.390+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _PCWjuZdeOaovfmz8uLk6tfkmRgSdeHU 2020-04-28T12:54:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.391+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.410 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.392+0000 7fa3a385f180 10 manifest: total_size = 5242880 2020-04-28T12:54:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.392+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.109 2020-04-28T12:54:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.392+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.392+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:34.411 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.392+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7.1668 2020-04-28T12:54:34.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.396+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.396+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.413 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:34.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:34.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:34.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x0 2020-04-28T12:54:34.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:34.414 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2020-04-28T12:54:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.397+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.109 2020-04-28T12:54:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.399+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.399+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-copy.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:34.415 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.400+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:34.416 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.411+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa374064640 msgr2=0x7fa37406b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.436 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.431+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37407c2c0 msgr2=0x7fa37406b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.477 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.473+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407d060 msgr2=0x7fa3740637f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.475+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37407d600 msgr2=0x7fa37407b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.517 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.512+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407b0f0 msgr2=0x7fa37406e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.526 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.522+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:34.526 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.522+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.522+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.522+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.642+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:34.647 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.642+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2020-04-28T12:54:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2020-04-28T12:54:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:34.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2020-04-28T12:54:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2020-04-28T12:54:34.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.643+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94296649184720 notifier 4914 bl.length()=189 2020-04-28T12:54:34.650 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.645+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7 from cache 2020-04-28T12:54:34.650 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.645+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=246 2020-04-28T12:54:34.650 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.646+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94296649192224 notifier 4914 bl.length()=246 2020-04-28T12:54:34.714 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.709+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407c2c0 msgr2=0x7fa37406b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:34.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:34.720+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407b9e0 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:35.026 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:35.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:54:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2020-04-28T12:54:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:35.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.022+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=237 2020-04-28T12:54:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2020-04-28T12:54:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:35.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 : miss 2020-04-28T12:54:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 info.flags=0x16 2020-04-28T12:54:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 to cache LRU end 2020-04-28T12:54:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:35.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.023+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:35.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.024+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=330 2020-04-28T12:54:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.024+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 info.flags=0x13 2020-04-28T12:54:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.024+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 to cache LRU end 2020-04-28T12:54:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.024+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.024+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:35.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.024+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 2020-04-28T12:54:35.119 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.114+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37407b0f0 msgr2=0x7fa37407b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:35.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.141+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9]) start_after [] num_entries 1100 2020-04-28T12:54:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.207+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:54:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.235+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2020-04-28T12:54:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.240+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x55c32645fa30 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.241+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2020-04-28T12:54:35.326 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.321+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407c2c0 msgr2=0x7fa3740637f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:35.403 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.398+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:54:35.465 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.461+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2020-04-28T12:54:35.631 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.626+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2020-04-28T12:54:35.703 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.698+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2020-04-28T12:54:35.719 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.715+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2020-04-28T12:54:35.849 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.844+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2020-04-28T12:54:35.859 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.854+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:54:35.913 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.909+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa374071d30 msgr2=0x7fa37407c6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:35.955 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.950+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2020-04-28T12:54:35.972 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:35.967+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2020-04-28T12:54:36.036 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.032+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37407b9e0 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.061 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.056+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37407e0d0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.139 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.135+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c326785138 s->prefetch_data=0 2020-04-28T12:54:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.135+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.135+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.233 2020-04-28T12:54:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.135+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55c326785138 s->prefetch_data=0 2020-04-28T12:54:36.140 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.135+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326785138 2020-04-28T12:54:36.141 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.135+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.126 2020-04-28T12:54:36.143 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.138+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:54:36.143 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.138+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2020-04-28T12:54:36.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.139+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.233 2020-04-28T12:54:36.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.142+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c326785138 s->prefetch_data=0 2020-04-28T12:54:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.142+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.142+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.235 2020-04-28T12:54:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.142+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55c326785138 s->prefetch_data=0 2020-04-28T12:54:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.142+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326785138 2020-04-28T12:54:36.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.142+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.182 2020-04-28T12:54:36.149 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.145+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.149 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.145+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.145+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.145+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.145+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.145+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.145+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:36.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.146+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.235 2020-04-28T12:54:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.147+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.148+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.154 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.148+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _CHnsenF6KoXAsAZoZTnPjZs7Yff-HN3 2020-04-28T12:54:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.148+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.148+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.148+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.192 2020-04-28T12:54:36.155 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.151+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.151+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.156 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.157 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.159 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.152+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _CHnsenF6KoXAsAZoZTnPjZs7Yff-HN3 2020-04-28T12:54:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.154+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.154+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.154+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.224 2020-04-28T12:54:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.154+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.154+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.154+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.501 2020-04-28T12:54:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.158+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.162 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.158+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.158+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.158+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.158+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.158+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.163 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.158+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.164 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:36.165 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:36.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.159+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.224 2020-04-28T12:54:36.167 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.161+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.167 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.161+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.167 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.161+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _USItv9yFHxHbaFMDUhIm92DMv6Sc-54 2020-04-28T12:54:36.167 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.161+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.168 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.161+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.168 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.161+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.625 2020-04-28T12:54:36.168 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.164+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.164+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.164+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.164+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.164+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.164+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.164+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.165+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _USItv9yFHxHbaFMDUhIm92DMv6Sc-54 2020-04-28T12:54:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.167+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.167+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.167+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _bm16JxxCE8Q7YonaqBam316X9-YXlnY 2020-04-28T12:54:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.167+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.167+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.167+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.965 2020-04-28T12:54:36.174 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.170+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.175 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.170+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.170+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.171+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _bm16JxxCE8Q7YonaqBam316X9-YXlnY 2020-04-28T12:54:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.173+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.173+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.173+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _I2QeUMFR-v4RhAP5r1yyBYSKjinyzvr 2020-04-28T12:54:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.173+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.173+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.173+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.1116 2020-04-28T12:54:36.181 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.176+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.181 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.176+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.182 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.182 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.182 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.182 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.177+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _I2QeUMFR-v4RhAP5r1yyBYSKjinyzvr 2020-04-28T12:54:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.179+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.179+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.179+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.245 2020-04-28T12:54:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.179+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.179+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.186 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.179+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.1151 2020-04-28T12:54:36.187 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.183+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.187 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.183+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.188 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.183+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.188 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.183+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.188 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.183+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.188 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.183+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.188 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.183+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.189 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.189 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.189 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.189 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.190 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.190 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.190 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.190 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:36.190 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.190 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.184+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.245 2020-04-28T12:54:36.193 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.185+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.193 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.186+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.193 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.186+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _X6uTmL0f7qSfP7Az0xRSoYOH5G6S8mV 2020-04-28T12:54:36.194 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.186+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.194 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.186+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.194 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.186+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.1419 2020-04-28T12:54:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.189+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.189+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.189+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.189+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.195 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.189+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.189+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.189+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.190+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _X6uTmL0f7qSfP7Az0xRSoYOH5G6S8mV 2020-04-28T12:54:36.198 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.192+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.198 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.192+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.198 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.192+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.242 2020-04-28T12:54:36.199 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.192+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.199 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.192+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.199 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.192+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.1438 2020-04-28T12:54:36.199 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.194+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407c2c0 msgr2=0x7fa3740637f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.200 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.203 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.204 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:36.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.196+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.242 2020-04-28T12:54:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.198+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.198+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.198+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to _O536msUxOA7h49_he2tZZ3PHCmkJImy 2020-04-28T12:54:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.198+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.198+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.198+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.1634 2020-04-28T12:54:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.202+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.202+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.202+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.202+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.202+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.208 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.202+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.202+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2020-04-28T12:54:36.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.203+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _O536msUxOA7h49_he2tZZ3PHCmkJImy 2020-04-28T12:54:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.204+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.205+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.205+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.225 2020-04-28T12:54:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.205+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55c326616908 s->prefetch_data=0 2020-04-28T12:54:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.205+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326616908 2020-04-28T12:54:36.211 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.205+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9.1668 2020-04-28T12:54:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.208+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.208+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x0 2020-04-28T12:54:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:36.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:36.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.209+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.225 2020-04-28T12:54:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.211+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.211+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart-copy.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:36.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.211+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:36.296 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.292+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407c2c0 msgr2=0x7fa37406e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:36.332 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.328+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:36.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.328+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:36.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.328+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:36.333 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.328+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:36.362 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.357+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407d060 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:36.386 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.381+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407d060 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.408 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.404+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407c2c0 msgr2=0x7fa37406e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.419 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.414+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa37407c2c0 msgr2=0x7fa37406e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.445 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.441+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.441+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:36.446 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2020-04-28T12:54:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2020-04-28T12:54:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2020-04-28T12:54:36.447 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2020-04-28T12:54:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.442+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94296649185888 notifier 4914 bl.length()=199 2020-04-28T12:54:36.448 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.444+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9 from cache 2020-04-28T12:54:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.444+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=256 2020-04-28T12:54:36.449 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.445+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879296 cookie 94296649194544 notifier 4914 bl.length()=256 2020-04-28T12:54:36.578 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.573+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407c2c0 msgr2=0x7fa37407a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.630 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.626+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407e0d0 msgr2=0x7fa37407cb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.712 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.707+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x55c32645fa30 msgr2=0x7fa37406e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.860 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.855+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:36.860 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.855+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:54:36.861 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2020-04-28T12:54:36.861 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:36.861 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:36.861 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:36.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:36.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=232 2020-04-28T12:54:36.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2020-04-28T12:54:36.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:36.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:36.863 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.856+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 : miss 2020-04-28T12:54:36.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 info.flags=0x16 2020-04-28T12:54:36.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 to cache LRU end 2020-04-28T12:54:36.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:36.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:36.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:36.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:36.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:36.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:36.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.857+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:36.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.858+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=325 2020-04-28T12:54:36.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.858+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 info.flags=0x13 2020-04-28T12:54:36.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.858+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 to cache LRU end 2020-04-28T12:54:36.866 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.858+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:36.866 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.858+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:36.866 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.858+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 2020-04-28T12:54:36.891 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.886+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa37407b0f0 msgr2=0x7fa37407b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.912 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.907+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37407d600 msgr2=0x7fa37407d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.930+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407d600 msgr2=0x7fa37407d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.957 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.953+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37406e8a0 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.958 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.953+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37406e8a0 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:36.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.956+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37407b9e0 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:36.988 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:36.984+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8]) start_after [] num_entries 1100 2020-04-28T12:54:37.090 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.085+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:54:37.272 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.268+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:54:37.444 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.440+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37406ec80 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:37.614 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.609+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407c2c0 msgr2=0x7fa37407a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:37.735 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.730+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:54:38.002 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.998+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.998+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.998+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.203 2020-04-28T12:54:38.003 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.998+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:38.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.998+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:38.004 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:37.998+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8.126 2020-04-28T12:54:38.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.001+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:54:38.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.001+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:38.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:54:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : miss 2020-04-28T12:54:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:54:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:38.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.002+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.003+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.203 2020-04-28T12:54:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.005+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.005+0000 7fa3a385f180 10 manifest: total_size = 11534336 2020-04-28T12:54:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.005+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.196 2020-04-28T12:54:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.005+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.005+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.005+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8.501 2020-04-28T12:54:38.013 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.008+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:38.013 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.008+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.013 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:38.013 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:54:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:38.014 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:54:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2020-04-28T12:54:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2020-04-28T12:54:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2020-04-28T12:54:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2020-04-28T12:54:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2020-04-28T12:54:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2020-04-28T12:54:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.009+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.196 2020-04-28T12:54:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.011+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.011+0000 7fa3a385f180 10 manifest: total_size = 16378 2020-04-28T12:54:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.011+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.210 2020-04-28T12:54:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.011+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.011+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:38.019 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.011+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8.1438 2020-04-28T12:54:38.020 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.015+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:38.020 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.015+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.021 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:38.021 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:54:38.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:38.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:38.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:38.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x0 2020-04-28T12:54:38.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:38.022 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:38.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:38.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:38.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2020-04-28T12:54:38.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2020-04-28T12:54:38.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7671 2020-04-28T12:54:38.023 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2020-04-28T12:54:38.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7671 2020-04-28T12:54:38.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2020-04-28T12:54:38.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2020-04-28T12:54:38.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=1035 2020-04-28T12:54:38.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2020-04-28T12:54:38.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.016+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.210 2020-04-28T12:54:38.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.018+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:38.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.018+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class-multipart.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:38.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.018+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:38.055 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.050+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407d060 msgr2=0x7fa37406d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:38.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.070+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa374079ae0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:38.087 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.082+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa37407c6a0 msgr2=0x7fa374084ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:38.088 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.083+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa374085450 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.131+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.131+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.131+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:38.137 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.131+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:38.238 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.233+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa374085450 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:38.250 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.246+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37407c6a0 msgr2=0x7fa374084ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2020-04-28T12:54:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2020-04-28T12:54:38.261 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2020-04-28T12:54:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.256+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2020-04-28T12:54:38.262 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.257+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94296649191472 notifier 4914 bl.length()=194 2020-04-28T12:54:38.263 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.259+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8 from cache 2020-04-28T12:54:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.259+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=251 2020-04-28T12:54:38.264 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.259+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879297 cookie 94296649194544 notifier 4914 bl.length()=251 2020-04-28T12:54:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.627+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:38.632 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.627+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:54:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2020-04-28T12:54:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:38.633 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=222 2020-04-28T12:54:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2020-04-28T12:54:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.628+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 : miss 2020-04-28T12:54:38.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 info.flags=0x16 2020-04-28T12:54:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 to cache LRU end 2020-04-28T12:54:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:38.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.629+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:38.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.630+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=315 2020-04-28T12:54:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.630+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 info.flags=0x13 2020-04-28T12:54:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.630+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 to cache LRU end 2020-04-28T12:54:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.630+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.630+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:38.638 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.630+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 2020-04-28T12:54:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.709+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407c2c0 msgr2=0x7fa37407b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:38.747 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.743+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6]) start_after [] num_entries 1100 2020-04-28T12:54:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.807+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2020-04-28T12:54:38.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.954+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407e0d0 msgr2=0x7fa37407cb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:38.993 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:38.988+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2020-04-28T12:54:39.090 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.085+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa374079ae0 msgr2=0x7fa374079f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.237 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.232+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37406f070 msgr2=0x7fa37406d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.396 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.391+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.421 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.417+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407e0d0 msgr2=0x7fa37407ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.438 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.434+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2020-04-28T12:54:39.704 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.700+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c326502048 s->prefetch_data=0 2020-04-28T12:54:39.705 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.700+0000 7fa3a385f180 10 manifest: total_size = 10485760 2020-04-28T12:54:39.705 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.700+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.85 2020-04-28T12:54:39.705 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.700+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55c326502048 s->prefetch_data=0 2020-04-28T12:54:39.706 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.700+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326502048 2020-04-28T12:54:39.706 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.700+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6.126 2020-04-28T12:54:39.708 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.703+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:54:39.708 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.703+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:39.709 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.704+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:39.709 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.704+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:54:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.704+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.704+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : miss 2020-04-28T12:54:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.704+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:54:39.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:39.711 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:54:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:54:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.705+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.85 2020-04-28T12:54:39.712 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.706+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c326502048 s->prefetch_data=0 2020-04-28T12:54:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.707+0000 7fa3a385f180 10 manifest: total_size = 10485760 2020-04-28T12:54:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.707+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.84 2020-04-28T12:54:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.707+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55c326502048 s->prefetch_data=0 2020-04-28T12:54:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.707+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326502048 2020-04-28T12:54:39.713 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.707+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6.501 2020-04-28T12:54:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.710+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.710+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:54:39.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:54:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:39.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2020-04-28T12:54:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2020-04-28T12:54:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2020-04-28T12:54:39.724 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.711+0000 7fa3a385f180 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.84 2020-04-28T12:54:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.713+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c326502048 s->prefetch_data=0 2020-04-28T12:54:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.713+0000 7fa3a385f180 10 manifest: total_size = 3302 2020-04-28T12:54:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.713+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.86 2020-04-28T12:54:39.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.713+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55c326502048 s->prefetch_data=0 2020-04-28T12:54:39.726 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.713+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c326502048 2020-04-28T12:54:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.713+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6.1438 2020-04-28T12:54:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.717+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:39.727 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.717+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.717+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:39.728 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.717+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:54:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.717+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.717+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:39.729 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.717+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:39.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:39.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 info.flags=0x0 2020-04-28T12:54:39.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:39.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:39.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-obj-storage-class.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.718+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.736+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407e0d0 msgr2=0x7fa37407ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.825 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.820+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37406f070 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.842 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.837+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:39.842 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.837+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:39.842 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.837+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:39.842 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.837+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:39.854 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.850+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa374085450 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.924 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.920+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37406f070 msgr2=0x7fa374062400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.929 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.925+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa37407e0d0 msgr2=0x7fa37407ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.937 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.932+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407bdc0 msgr2=0x7fa374061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.938 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.934+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa374085450 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.943+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407e0d0 msgr2=0x7fa37407ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.954+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.954+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.954+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2020-04-28T12:54:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.955+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2020-04-28T12:54:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.955+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.955+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.955+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.955+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2020-04-28T12:54:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.955+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2020-04-28T12:54:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.955+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879303 cookie 94296649184720 notifier 4914 bl.length()=184 2020-04-28T12:54:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.957+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6 from cache 2020-04-28T12:54:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.957+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=241 2020-04-28T12:54:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:39.957+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879304 cookie 94296649190592 notifier 4914 bl.length()=241 2020-04-28T12:54:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:54:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2020-04-28T12:54:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:40.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.340+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:54:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2020-04-28T12:54:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:40.347 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 : miss 2020-04-28T12:54:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 info.flags=0x16 2020-04-28T12:54:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 to cache LRU end 2020-04-28T12:54:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.341+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.342+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:54:40.349 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.342+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 info.flags=0x13 2020-04-28T12:54:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.342+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 to cache LRU end 2020-04-28T12:54:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.342+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.342+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:40.350 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.342+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 2020-04-28T12:54:40.398 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.393+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa374085450 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.429+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa374079ae0 msgr2=0x7fa374079ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:40.456 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.452+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10]) start_after [] num_entries 1100 2020-04-28T12:54:40.513 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.508+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:54:40.630 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.626+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:54:40.805 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:40.800+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:54:41.050 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.040+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37407b0f0 msgr2=0x7fa37407b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:41.250 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.245+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:54:41.468 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.463+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.469 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.464+0000 7fa3a385f180 10 manifest: total_size = 0 2020-04-28T12:54:41.469 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.464+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.305 2020-04-28T12:54:41.469 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.464+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.469 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.464+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:41.469 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.464+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10.111 2020-04-28T12:54:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.467+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:54:41.472 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.467+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : miss 2020-04-28T12:54:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.473 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:41.474 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.468+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.469+0000 7fa3a385f180 10 manifest: total_size = 0 2020-04-28T12:54:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.469+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.304 2020-04-28T12:54:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.469+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.469+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:41.475 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.469+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10.349 2020-04-28T12:54:41.476 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.472+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:41.476 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.472+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.472+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.477 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.472+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.472+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.472+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.472+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 10 manifest: total_size = 0 2020-04-28T12:54:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.306 2020-04-28T12:54:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:41.480 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.473+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10.695 2020-04-28T12:54:41.481 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.476+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:41.481 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.476+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.481 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.481 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.482 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.482 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:41.482 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.477+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.478+0000 7fa3a385f180 10 manifest: total_size = 0 2020-04-28T12:54:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.478+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.307 2020-04-28T12:54:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.478+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.478+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.478+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10.1557 2020-04-28T12:54:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.481+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.481+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 info.flags=0x0 2020-04-28T12:54:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.482+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:41.515 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.504+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa374085450 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:41.546 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.542+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407bdc0 msgr2=0x7fa374061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:41.571 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.567+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37407b0f0 msgr2=0x7fa37407b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.586+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407e0d0 msgr2=0x7fa37407ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.605+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.605+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.606+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.606+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:41.667 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.663+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407b0f0 msgr2=0x7fa37407b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:41.687 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.682+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa3740838c0 msgr2=0x7fa374083310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:41.721 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2020-04-28T12:54:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2020-04-28T12:54:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:41.722 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2020-04-28T12:54:41.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.716+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:54:41.723 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.717+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879299 cookie 94296649175184 notifier 4914 bl.length()=181 2020-04-28T12:54:41.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.719+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.10 from cache 2020-04-28T12:54:41.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.719+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=239 2020-04-28T12:54:41.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.720+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879305 cookie 94296647723968 notifier 4914 bl.length()=239 2020-04-28T12:54:41.899 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:41.895+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37407bdc0 msgr2=0x7fa374061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:42.085 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.080+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407c2c0 msgr2=0x7fa37407b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:42.103 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:42.104 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2020-04-28T12:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:42.105 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.099+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:54:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2020-04-28T12:54:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 : miss 2020-04-28T12:54:42.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 info.flags=0x16 2020-04-28T12:54:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 to cache LRU end 2020-04-28T12:54:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:42.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.100+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.101+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:54:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.101+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 info.flags=0x13 2020-04-28T12:54:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.101+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 to cache LRU end 2020-04-28T12:54:42.108 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.101+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.101+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:42.109 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.101+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 2020-04-28T12:54:42.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.166+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407e0d0 msgr2=0x7fa37407ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:42.175 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.171+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407bdc0 msgr2=0x7fa374061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.214+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407c2c0 msgr2=0x7fa37406da60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.221+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11]) start_after [] num_entries 1100 2020-04-28T12:54:42.284 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.279+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:54:42.400 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.396+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:54:42.497 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.492+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa37406e8a0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:42.572 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.568+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:54:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:42.989+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:54:43.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.202+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.202+0000 7fa3a385f180 10 manifest: total_size = 2078 2020-04-28T12:54:43.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.202+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.312 2020-04-28T12:54:43.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.202+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.202+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:43.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.202+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11.111 2020-04-28T12:54:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.206+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:54:43.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.206+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.206+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.206+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.206+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.206+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : miss 2020-04-28T12:54:43.212 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.206+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.213 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.213 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.213 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.213 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:43.213 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:43.213 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:43.213 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 10 manifest: total_size = 527 2020-04-28T12:54:43.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.311 2020-04-28T12:54:43.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:43.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.207+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11.349 2020-04-28T12:54:43.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.210+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.210+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.211+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.212+0000 7fa3a385f180 10 manifest: total_size = 524288 2020-04-28T12:54:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.212+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.313 2020-04-28T12:54:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.212+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.212+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.212+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11.695 2020-04-28T12:54:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.215+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.215+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.215+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.215+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.215+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.215+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.215+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 10 manifest: total_size = 524288 2020-04-28T12:54:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.314 2020-04-28T12:54:43.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:43.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:43.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.216+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11.1557 2020-04-28T12:54:43.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.219+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:43.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.219+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 info.flags=0x0 2020-04-28T12:54:43.227 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.220+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.2[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:43.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.221+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:43.230 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.226+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37407c6a0 msgr2=0x7fa37407a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.232 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.228+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x7fa37407c2c0 msgr2=0x7fa37407d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.236+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa37407b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.267 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.262+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407daf0 msgr2=0x7fa3740714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.271+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407bdc0 msgr2=0x7fa374061ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.287 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.282+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37406f070 msgr2=0x7fa37407b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.329 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.324+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37407daf0 msgr2=0x7fa374063920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.345 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.341+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.341+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.341+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.341+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.353+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407c2c0 msgr2=0x7fa374066f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.374+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407abe0 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.412 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.408+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407abe0 msgr2=0x7fa37406e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.447 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.440+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6824/23547,v1:172.21.15.26:6825/23547] conn(0x7fa3740838c0 msgr2=0x7fa3740832f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.451+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407c2c0 msgr2=0x7fa374087e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:43.477 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2020-04-28T12:54:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2020-04-28T12:54:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:43.478 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2020-04-28T12:54:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.473+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:54:43.479 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.474+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879300 cookie 94296649175184 notifier 4914 bl.length()=181 2020-04-28T12:54:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.476+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.11 from cache 2020-04-28T12:54:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.476+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=239 2020-04-28T12:54:43.481 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.477+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879306 cookie 94296647723968 notifier 4914 bl.length()=239 2020-04-28T12:54:43.536 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.532+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37407e0d0 msgr2=0x7fa37407ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.599 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.595+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fa37406e8a0 msgr2=0x7fa37407e890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.615 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.610+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa37407daf0 msgr2=0x7fa374067560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.856+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55c3262f03c0 s->prefetch_data=0 2020-04-28T12:54:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.856+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:54:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2020-04-28T12:54:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2020-04-28T12:54:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=221 2020-04-28T12:54:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2020-04-28T12:54:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:43.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4d90 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:43.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.857+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 : miss 2020-04-28T12:54:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 info.flags=0x16 2020-04-28T12:54:43.866 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 to cache LRU end 2020-04-28T12:54:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 20 Read xattr: user.rgw.acl 2020-04-28T12:54:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 20 Read xattr: user.rgw.idtag 2020-04-28T12:54:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 : type miss (requested=0x13, cached=0x16) 2020-04-28T12:54:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.858+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.859+0000 7fa3a385f180 20 rados_obj.operate() r=0 bl.length=314 2020-04-28T12:54:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.859+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 info.flags=0x13 2020-04-28T12:54:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.859+0000 7fa3a385f180 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 to cache LRU end 2020-04-28T12:54:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.859+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.859+0000 7fa3a385f180 10 updating xattr: name=user.rgw.acl bl.length()=209 2020-04-28T12:54:43.869 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.859+0000 7fa3a385f180 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 2020-04-28T12:54:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.895+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa3740838c0 msgr2=0x7fa3740832f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2020-04-28T12:54:43.983 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:43.979+0000 7fa3a385f180 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12]) start_after [] num_entries 1100 2020-04-28T12:54:44.042 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:44.037+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got __[] 2020-04-28T12:54:44.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:44.155+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got obj[] 2020-04-28T12:54:44.336 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:44.331+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got ___[] 2020-04-28T12:54:44.682 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:44.677+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa3740838c0 msgr2=0x7fa374071800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:44.775+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7fa37406f070 msgr2=0x7fa37407b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:44.779+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2020-04-28T12:54:45.009 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.004+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.005+0000 7fa3a385f180 10 manifest: total_size = 49187 2020-04-28T12:54:45.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.005+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.319 2020-04-28T12:54:45.010 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.005+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.005+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:45.011 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.005+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12.111 2020-04-28T12:54:45.021 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.008+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:54:45.021 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.008+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.026 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.009+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.026 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.009+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.026 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.009+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.009+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : miss 2020-04-28T12:54:45.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.009+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 10 adding default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:45.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:45.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:45.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 10 manifest: total_size = 49187 2020-04-28T12:54:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.318 2020-04-28T12:54:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.010+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12.349 2020-04-28T12:54:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.013+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.013+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:45.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.031 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.032 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:45.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:45.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:45.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.014+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.015+0000 7fa3a385f180 10 manifest: total_size = 1035 2020-04-28T12:54:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.015+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.320 2020-04-28T12:54:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.015+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.015+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:45.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.015+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12.695 2020-04-28T12:54:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.018+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.018+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.036 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.037 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.037 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:45.037 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:45.037 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:45.038 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.019+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.038 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.020+0000 7fa3a385f180 10 manifest: total_size = 110 2020-04-28T12:54:45.038 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.020+0000 7fa3a385f180 20 get_obj_state: setting s->obj_tag to 5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.321 2020-04-28T12:54:45.038 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.020+0000 7fa3a385f180 20 get_obj_state: rctx=0x7fff1bad4d30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55c3265c0728 s->prefetch_data=0 2020-04-28T12:54:45.039 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.020+0000 7fa3a385f180 20 prepare_atomic_modification: state is not atomic. state=0x55c3265c0728 2020-04-28T12:54:45.039 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.020+0000 7fa3a385f180 20 bucket index object: default.rgw.buckets.index:.dir.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12.1557 2020-04-28T12:54:45.040 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:45.041 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.041 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.041 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.042 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-source-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.042 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 cache get: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 : type miss (requested=0x11, cached=0x0) 2020-04-28T12:54:45.042 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 20 rados->read ofs=0 len=0 2020-04-28T12:54:45.042 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:54:45.043 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 cache put: name=default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 info.flags=0x0 2020-04-28T12:54:45.043 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 moving default.rgw.log++bucket.sync-target-hints.test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.043 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 chain_cache_entry: cache_locator= 2020-04-28T12:54:45.044 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 20 chain_cache_entry: couldn't find cache locator 2020-04-28T12:54:45.044 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 20 couldn't put bucket_sync_policy cache entry, might have raced with data changes 2020-04-28T12:54:45.044 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered beginning attempt=1 2020-04-28T12:54:45.044 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.023+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered: :test-client.0-r-test-small-obj-data.3[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12]) start_after="[]", prefix="_multipart_" num_entries=1001, list_versions=0, expansion_factor=1 2020-04-28T12:54:45.045 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.024+0000 7fa3a385f180 10 RGWRados::cls_bucket_list_ordered request from each of 1999 shard(s) for 8 entries to get 1001 total entries 2020-04-28T12:54:45.068 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.063+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6800/23447,v1:172.21.15.26:6801/23447] conn(0x7fa37407daf0 msgr2=0x7fa37407d060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:45.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.068+0000 7fa392049700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6808/23496,v1:172.21.15.26:6809/23496] conn(0x7fa37406f070 msgr2=0x7fa374066f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.154+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, count=0, is_truncated=0 2020-04-28T12:54:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.154+0000 7fa3a385f180 20 RGWRados::cls_bucket_list_ordered: returning, last_entry NOT SET 2020-04-28T12:54:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.154+0000 7fa3a385f180 20 RGWRados::Bucket::List::list_objects_ordered INFO end of outer loop, truncated=0, count=0, attempt=1 2020-04-28T12:54:45.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.154+0000 7fa3a385f180 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12])"; objs.size()=0; is_truncated=0 2020-04-28T12:54:45.170 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.165+0000 7fa391848700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.26:6816/23527,v1:172.21.15.26:6817/23527] conn(0x7fa374061ea0 msgr2=0x7fa37407bcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:45.192 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.188+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa374066f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:45.249 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.244+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa374066f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:45.267 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.263+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa3740838c0 msgr2=0x7fa37407b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:45.273 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 20 get_system_obj_state: rctx=0x7fff1bad4528 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55c32632c170 s->prefetch_data=0 2020-04-28T12:54:45.273 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2020-04-28T12:54:45.274 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2020-04-28T12:54:45.274 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2020-04-28T12:54:45.274 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 10 updating xattr: name=ceph.objclass.version bl.length()=42 2020-04-28T12:54:45.274 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 20 get_system_obj_state: s->obj_tag was set empty 2020-04-28T12:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2020-04-28T12:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2020-04-28T12:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.269+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2020-04-28T12:54:45.275 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.270+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94296649175184 notifier 4914 bl.length()=181 2020-04-28T12:54:45.276 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.272+0000 7fa3a385f180 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.12 from cache 2020-04-28T12:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.272+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=239 2020-04-28T12:54:45.277 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.272+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879307 cookie 94296647723968 notifier 4914 bl.length()=239 2020-04-28T12:54:45.511 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.506+0000 7fa38bfff700 0 -- 172.21.15.26:0/3947548153 >> [v2:172.21.15.107:6802/23415,v1:172.21.15.107:6803/23415] conn(0x7fa37406f070 msgr2=0x7fa3740717e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:54:45.680 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.676+0000 7fa3a385f180 10 removing key index: KONFRKUBOJTKLEGDYSRW 2020-04-28T12:54:45.681 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.676+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2020-04-28T12:54:45.681 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.676+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879308 cookie 94296647723968 notifier 4914 bl.length()=170 2020-04-28T12:54:45.683 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.678+0000 7fa3a385f180 10 removing email index: ragweed.client.0+test@test.test 2020-04-28T12:54:45.683 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.678+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2020-04-28T12:54:45.683 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.679+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879304 cookie 94296649184720 notifier 4914 bl.length()=182 2020-04-28T12:54:45.685 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.681+0000 7fa3a385f180 10 removing user buckets index 2020-04-28T12:54:45.685 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.681+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2020-04-28T12:54:45.686 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.681+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879301 cookie 94296649191472 notifier 4914 bl.length()=173 2020-04-28T12:54:45.688 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.683+0000 7fa3a385f180 10 removing user index: ragweed.client.0 2020-04-28T12:54:45.688 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.683+0000 7fa3a385f180 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2020-04-28T12:54:45.688 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.683+0000 7fa3a385f180 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2020-04-28T12:54:45.688 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.683+0000 7fa372ffd700 10 RGWWatcher::handle_notify() notify_id 541165879309 cookie 94296649190592 notifier 4914 bl.length()=165 2020-04-28T12:54:45.690 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.686+0000 7fa3627dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:54:45.691 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.687+0000 7fa3a385f180 20 remove_watcher() i=0 2020-04-28T12:54:45.692 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.687+0000 7fa3a385f180 2 removed watcher, disabling cache 2020-04-28T12:54:45.693 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.688+0000 7fa3a385f180 20 remove_watcher() i=1 2020-04-28T12:54:45.694 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.690+0000 7fa3a385f180 20 remove_watcher() i=2 2020-04-28T12:54:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.691+0000 7fa3a385f180 20 remove_watcher() i=3 2020-04-28T12:54:45.698 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.693+0000 7fa3a385f180 20 remove_watcher() i=4 2020-04-28T12:54:45.699 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.694+0000 7fa3a385f180 20 remove_watcher() i=5 2020-04-28T12:54:45.715 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.696+0000 7fa3a385f180 20 remove_watcher() i=6 2020-04-28T12:54:45.715 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:54:45.697+0000 7fa3a385f180 20 remove_watcher() i=7 2020-04-28T12:54:45.716 INFO:tasks.ragweed:Removing ragweed... 2020-04-28T12:54:45.716 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:54:45.769 INFO:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/ragweed 2020-04-28T12:54:45.865 INFO:teuthology.run_tasks:Running task s3tests-java... 2020-04-28T12:54:45.877 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2020-04-28T12:54:45.877 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2020-04-28T12:54:45.877 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2020-04-28T12:54:45.877 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:54:45.905 INFO:teuthology.orchestra.run.smithi026:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2020-04-28T12:54:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2020-04-28T12:54:53.044 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2020-04-28T12:54:53.044 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:54:53.102 INFO:teuthology.orchestra.run.smithi026:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2020-04-28T12:54:54.624 INFO:teuthology.orchestra.run.smithi026.stdout: Gradle will be installed under /opt/gradle 2020-04-28T12:54:54.913 INFO:teuthology.orchestra.run.smithi026.stderr:--2020-04-28 12:54:54-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:54:54.953 INFO:teuthology.orchestra.run.smithi026.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:be09, ... 2020-04-28T12:54:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2020-04-28T12:54:55.074 INFO:teuthology.orchestra.run.smithi026.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2020-04-28T12:54:55.075 INFO:teuthology.orchestra.run.smithi026.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip [following] 2020-04-28T12:54:55.075 INFO:teuthology.orchestra.run.smithi026.stderr:--2020-04-28 12:54:55-- https://downloads.gradle-dn.com/distributions/gradle-6.0.1-bin.zip 2020-04-28T12:54:55.075 INFO:teuthology.orchestra.run.smithi026.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.159.20, 104.17.160.20, 2606:4700::6811:a014, ... 2020-04-28T12:54:55.093 INFO:teuthology.orchestra.run.smithi026.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.159.20|:443... connected. 2020-04-28T12:54:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:HTTP request sent, awaiting response... 200 OK 2020-04-28T12:54:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:Length: 95129672 (91M) [application/zip] 2020-04-28T12:54:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2020-04-28T12:54:55.270 INFO:teuthology.orchestra.run.smithi026.stderr: 2020-04-28T12:54:55.290 INFO:teuthology.orchestra.run.smithi026.stderr: 0K .......... .......... .......... .......... .......... 0% 73.9M 1s 2020-04-28T12:54:55.290 INFO:teuthology.orchestra.run.smithi026.stderr: 50K .......... .......... .......... .......... .......... 0% 117M 1s 2020-04-28T12:54:55.290 INFO:teuthology.orchestra.run.smithi026.stderr: 100K .......... .......... .......... .......... .......... 0% 139M 1s 2020-04-28T12:54:55.290 INFO:teuthology.orchestra.run.smithi026.stderr: 150K .......... .......... .......... .......... .......... 0% 123M 1s 2020-04-28T12:54:55.290 INFO:teuthology.orchestra.run.smithi026.stderr: 200K .......... .......... .......... .......... .......... 0% 2.90M 7s 2020-04-28T12:54:55.291 INFO:teuthology.orchestra.run.smithi026.stderr: 250K .......... .......... .......... .......... .......... 0% 56.0M 6s 2020-04-28T12:54:55.305 INFO:teuthology.orchestra.run.smithi026.stderr: 300K .......... .......... .......... .......... .......... 0% 2.96M 10s 2020-04-28T12:54:55.306 INFO:teuthology.orchestra.run.smithi026.stderr: 350K .......... .......... .......... .......... .......... 0% 47.0M 9s 2020-04-28T12:54:55.307 INFO:teuthology.orchestra.run.smithi026.stderr: 400K .......... .......... .......... .......... .......... 0% 51.6M 8s 2020-04-28T12:54:55.307 INFO:teuthology.orchestra.run.smithi026.stderr: 450K .......... .......... .......... .......... .......... 0% 68.6M 7s 2020-04-28T12:54:55.308 INFO:teuthology.orchestra.run.smithi026.stderr: 500K .......... .......... .......... .......... .......... 0% 52.6M 7s 2020-04-28T12:54:55.323 INFO:teuthology.orchestra.run.smithi026.stderr: 550K .......... .......... .......... .......... .......... 0% 3.28M 8s 2020-04-28T12:54:55.324 INFO:teuthology.orchestra.run.smithi026.stderr: 600K .......... .......... .......... .......... .......... 0% 48.4M 8s 2020-04-28T12:54:55.325 INFO:teuthology.orchestra.run.smithi026.stderr: 650K .......... .......... .......... .......... .......... 0% 50.4M 7s 2020-04-28T12:54:55.326 INFO:teuthology.orchestra.run.smithi026.stderr: 700K .......... .......... .......... .......... .......... 0% 45.8M 7s 2020-04-28T12:54:55.327 INFO:teuthology.orchestra.run.smithi026.stderr: 750K .......... .......... .......... .......... .......... 0% 38.8M 7s 2020-04-28T12:54:55.329 INFO:teuthology.orchestra.run.smithi026.stderr: 800K .......... .......... .......... .......... .......... 0% 44.7M 6s 2020-04-28T12:54:55.329 INFO:teuthology.orchestra.run.smithi026.stderr: 850K .......... .......... .......... .......... .......... 0% 44.3M 6s 2020-04-28T12:54:55.331 INFO:teuthology.orchestra.run.smithi026.stderr: 900K .......... .......... .......... .......... .......... 1% 40.5M 6s 2020-04-28T12:54:55.331 INFO:teuthology.orchestra.run.smithi026.stderr: 950K .......... .......... .......... .......... .......... 1% 47.9M 6s 2020-04-28T12:54:55.344 INFO:teuthology.orchestra.run.smithi026.stderr: 1000K .......... .......... .......... .......... .......... 1% 5.28M 6s 2020-04-28T12:54:55.345 INFO:teuthology.orchestra.run.smithi026.stderr: 1050K .......... .......... .......... .......... .......... 1% 104M 6s 2020-04-28T12:54:55.345 INFO:teuthology.orchestra.run.smithi026.stderr: 1100K .......... .......... .......... .......... .......... 1% 62.4M 6s 2020-04-28T12:54:55.345 INFO:teuthology.orchestra.run.smithi026.stderr: 1150K .......... .......... .......... .......... .......... 1% 40.9M 6s 2020-04-28T12:54:55.345 INFO:teuthology.orchestra.run.smithi026.stderr: 1200K .......... .......... .......... .......... .......... 1% 53.4M 6s 2020-04-28T12:54:55.347 INFO:teuthology.orchestra.run.smithi026.stderr: 1250K .......... .......... .......... .......... .......... 1% 58.9M 5s 2020-04-28T12:54:55.347 INFO:teuthology.orchestra.run.smithi026.stderr: 1300K .......... .......... .......... .......... .......... 1% 57.0M 5s 2020-04-28T12:54:55.348 INFO:teuthology.orchestra.run.smithi026.stderr: 1350K .......... .......... .......... .......... .......... 1% 49.9M 5s 2020-04-28T12:54:55.351 INFO:teuthology.orchestra.run.smithi026.stderr: 1400K .......... .......... .......... .......... .......... 1% 54.9M 5s 2020-04-28T12:54:55.351 INFO:teuthology.orchestra.run.smithi026.stderr: 1450K .......... .......... .......... .......... .......... 1% 62.0M 5s 2020-04-28T12:54:55.351 INFO:teuthology.orchestra.run.smithi026.stderr: 1500K .......... .......... .......... .......... .......... 1% 50.9M 5s 2020-04-28T12:54:55.352 INFO:teuthology.orchestra.run.smithi026.stderr: 1550K .......... .......... .......... .......... .......... 1% 46.3M 5s 2020-04-28T12:54:55.355 INFO:teuthology.orchestra.run.smithi026.stderr: 1600K .......... .......... .......... .......... .......... 1% 53.5M 5s 2020-04-28T12:54:55.356 INFO:teuthology.orchestra.run.smithi026.stderr: 1650K .......... .......... .......... .......... .......... 1% 51.9M 5s 2020-04-28T12:54:55.356 INFO:teuthology.orchestra.run.smithi026.stderr: 1700K .......... .......... .......... .......... .......... 1% 55.0M 4s 2020-04-28T12:54:55.356 INFO:teuthology.orchestra.run.smithi026.stderr: 1750K .......... .......... .......... .......... .......... 1% 57.6M 4s 2020-04-28T12:54:55.356 INFO:teuthology.orchestra.run.smithi026.stderr: 1800K .......... .......... .......... .......... .......... 1% 54.9M 4s 2020-04-28T12:54:55.360 INFO:teuthology.orchestra.run.smithi026.stderr: 1850K .......... .......... .......... .......... .......... 2% 16.3M 4s 2020-04-28T12:54:55.360 INFO:teuthology.orchestra.run.smithi026.stderr: 1900K .......... .......... .......... .......... .......... 2% 117M 4s 2020-04-28T12:54:55.360 INFO:teuthology.orchestra.run.smithi026.stderr: 1950K .......... .......... .......... .......... .......... 2% 63.4M 4s 2020-04-28T12:54:55.361 INFO:teuthology.orchestra.run.smithi026.stderr: 2000K .......... .......... .......... .......... .......... 2% 74.7M 4s 2020-04-28T12:54:55.368 INFO:teuthology.orchestra.run.smithi026.stderr: 2050K .......... .......... .......... .......... .......... 2% 61.7M 4s 2020-04-28T12:54:55.368 INFO:teuthology.orchestra.run.smithi026.stderr: 2100K .......... .......... .......... .......... .......... 2% 72.2M 4s 2020-04-28T12:54:55.369 INFO:teuthology.orchestra.run.smithi026.stderr: 2150K .......... .......... .......... .......... .......... 2% 65.9M 4s 2020-04-28T12:54:55.369 INFO:teuthology.orchestra.run.smithi026.stderr: 2200K .......... .......... .......... .......... .......... 2% 61.0M 4s 2020-04-28T12:54:55.369 INFO:teuthology.orchestra.run.smithi026.stderr: 2250K .......... .......... .......... .......... .......... 2% 80.4M 4s 2020-04-28T12:54:55.369 INFO:teuthology.orchestra.run.smithi026.stderr: 2300K .......... .......... .......... .......... .......... 2% 74.3M 4s 2020-04-28T12:54:55.369 INFO:teuthology.orchestra.run.smithi026.stderr: 2350K .......... .......... .......... .......... .......... 2% 51.4M 4s 2020-04-28T12:54:55.369 INFO:teuthology.orchestra.run.smithi026.stderr: 2400K .......... .......... .......... .......... .......... 2% 61.1M 4s 2020-04-28T12:54:55.369 INFO:teuthology.orchestra.run.smithi026.stderr: 2450K .......... .......... .......... .......... .......... 2% 57.2M 4s 2020-04-28T12:54:55.370 INFO:teuthology.orchestra.run.smithi026.stderr: 2500K .......... .......... .......... .......... .......... 2% 42.8M 4s 2020-04-28T12:54:56.786 INFO:teuthology.orchestra.run.smithi026.stderr: 2550K .......... .......... .......... .......... .......... 2% 61.0M 3s 2020-04-28T12:54:56.786 INFO:teuthology.orchestra.run.smithi026.stderr: 2600K .......... .......... .......... .......... .......... 2% 49.8M 3s 2020-04-28T12:54:56.786 INFO:teuthology.orchestra.run.smithi026.stderr: 2650K .......... .......... .......... .......... .......... 2% 118M 3s 2020-04-28T12:54:56.787 INFO:teuthology.orchestra.run.smithi026.stderr: 2700K .......... .......... .......... .......... .......... 2% 104M 3s 2020-04-28T12:54:56.787 INFO:teuthology.orchestra.run.smithi026.stderr: 2750K .......... .......... .......... .......... .......... 3% 87.1M 3s 2020-04-28T12:54:56.787 INFO:teuthology.orchestra.run.smithi026.stderr: 2800K .......... .......... .......... .......... .......... 3% 51.6M 3s 2020-04-28T12:54:56.787 INFO:teuthology.orchestra.run.smithi026.stderr: 2850K .......... .......... .......... .......... .......... 3% 74.9M 3s 2020-04-28T12:54:56.787 INFO:teuthology.orchestra.run.smithi026.stderr: 2900K .......... .......... .......... .......... .......... 3% 48.5M 3s 2020-04-28T12:54:56.787 INFO:teuthology.orchestra.run.smithi026.stderr: 2950K .......... .......... .......... .......... .......... 3% 67.4M 3s 2020-04-28T12:54:56.787 INFO:teuthology.orchestra.run.smithi026.stderr: 3000K .......... .......... .......... .......... .......... 3% 81.1M 3s 2020-04-28T12:54:56.788 INFO:teuthology.orchestra.run.smithi026.stderr: 3050K .......... .......... .......... .......... .......... 3% 114M 3s 2020-04-28T12:54:56.788 INFO:teuthology.orchestra.run.smithi026.stderr: 3100K .......... .......... .......... .......... .......... 3% 82.9M 3s 2020-04-28T12:54:56.788 INFO:teuthology.orchestra.run.smithi026.stderr: 3150K .......... .......... .......... .......... .......... 3% 95.9M 3s 2020-04-28T12:54:56.788 INFO:teuthology.orchestra.run.smithi026.stderr: 3200K .......... .......... .......... .......... .......... 3% 98.1M 3s 2020-04-28T12:54:56.789 INFO:teuthology.orchestra.run.smithi026.stderr: 3250K .......... .......... .......... .......... .......... 3% 51.2M 3s 2020-04-28T12:54:56.789 INFO:teuthology.orchestra.run.smithi026.stderr: 3300K .......... .......... .......... .......... .......... 3% 89.5M 3s 2020-04-28T12:54:56.789 INFO:teuthology.orchestra.run.smithi026.stderr: 3350K .......... .......... .......... .......... .......... 3% 111M 3s 2020-04-28T12:54:56.789 INFO:teuthology.orchestra.run.smithi026.stderr: 3400K .......... .......... .......... .......... .......... 3% 120M 3s 2020-04-28T12:54:56.789 INFO:teuthology.orchestra.run.smithi026.stderr: 3450K .......... .......... .......... .......... .......... 3% 102M 3s 2020-04-28T12:54:56.789 INFO:teuthology.orchestra.run.smithi026.stderr: 3500K .......... .......... .......... .......... .......... 3% 129M 3s 2020-04-28T12:54:56.790 INFO:teuthology.orchestra.run.smithi026.stderr: 3550K .......... .......... .......... .......... .......... 3% 89.5M 3s 2020-04-28T12:54:56.790 INFO:teuthology.orchestra.run.smithi026.stderr: 3600K .......... .......... .......... .......... .......... 3% 114M 3s 2020-04-28T12:54:56.790 INFO:teuthology.orchestra.run.smithi026.stderr: 3650K .......... .......... .......... .......... .......... 3% 117M 3s 2020-04-28T12:54:56.790 INFO:teuthology.orchestra.run.smithi026.stderr: 3700K .......... .......... .......... .......... .......... 4% 111M 3s 2020-04-28T12:54:56.790 INFO:teuthology.orchestra.run.smithi026.stderr: 3750K .......... .......... .......... .......... .......... 4% 111M 3s 2020-04-28T12:54:56.790 INFO:teuthology.orchestra.run.smithi026.stderr: 3800K .......... .......... .......... .......... .......... 4% 118M 3s 2020-04-28T12:54:56.790 INFO:teuthology.orchestra.run.smithi026.stderr: 3850K .......... .......... .......... .......... .......... 4% 120M 3s 2020-04-28T12:54:56.791 INFO:teuthology.orchestra.run.smithi026.stderr: 3900K .......... .......... .......... .......... .......... 4% 114M 3s 2020-04-28T12:54:56.791 INFO:teuthology.orchestra.run.smithi026.stderr: 3950K .......... .......... .......... .......... .......... 4% 89.0M 3s 2020-04-28T12:54:56.791 INFO:teuthology.orchestra.run.smithi026.stderr: 4000K .......... .......... .......... .......... .......... 4% 122M 3s 2020-04-28T12:54:56.791 INFO:teuthology.orchestra.run.smithi026.stderr: 4050K .......... .......... .......... .......... .......... 4% 116M 3s 2020-04-28T12:54:56.791 INFO:teuthology.orchestra.run.smithi026.stderr: 4100K .......... .......... .......... .......... .......... 4% 109M 3s 2020-04-28T12:54:56.791 INFO:teuthology.orchestra.run.smithi026.stderr: 4150K .......... .......... .......... .......... .......... 4% 115M 2s 2020-04-28T12:54:56.792 INFO:teuthology.orchestra.run.smithi026.stderr: 4200K .......... .......... .......... .......... .......... 4% 120M 2s 2020-04-28T12:54:56.792 INFO:teuthology.orchestra.run.smithi026.stderr: 4250K .......... .......... .......... .......... .......... 4% 115M 2s 2020-04-28T12:54:56.792 INFO:teuthology.orchestra.run.smithi026.stderr: 4300K .......... .......... .......... .......... .......... 4% 115M 2s 2020-04-28T12:54:56.792 INFO:teuthology.orchestra.run.smithi026.stderr: 4350K .......... .......... .......... .......... .......... 4% 91.9M 2s 2020-04-28T12:54:56.792 INFO:teuthology.orchestra.run.smithi026.stderr: 4400K .......... .......... .......... .......... .......... 4% 116M 2s 2020-04-28T12:54:56.793 INFO:teuthology.orchestra.run.smithi026.stderr: 4450K .......... .......... .......... .......... .......... 4% 115M 2s 2020-04-28T12:54:56.793 INFO:teuthology.orchestra.run.smithi026.stderr: 4500K .......... .......... .......... .......... .......... 4% 128M 2s 2020-04-28T12:54:56.793 INFO:teuthology.orchestra.run.smithi026.stderr: 4550K .......... .......... .......... .......... .......... 4% 104M 2s 2020-04-28T12:54:56.793 INFO:teuthology.orchestra.run.smithi026.stderr: 4600K .......... .......... .......... .......... .......... 5% 120M 2s 2020-04-28T12:54:56.793 INFO:teuthology.orchestra.run.smithi026.stderr: 4650K .......... .......... .......... .......... .......... 5% 117M 2s 2020-04-28T12:54:56.793 INFO:teuthology.orchestra.run.smithi026.stderr: 4700K .......... .......... .......... .......... .......... 5% 119M 2s 2020-04-28T12:54:56.794 INFO:teuthology.orchestra.run.smithi026.stderr: 4750K .......... .......... .......... .......... .......... 5% 87.0M 2s 2020-04-28T12:54:56.794 INFO:teuthology.orchestra.run.smithi026.stderr: 4800K .......... .......... .......... .......... .......... 5% 106M 2s 2020-04-28T12:54:56.794 INFO:teuthology.orchestra.run.smithi026.stderr: 4850K .......... .......... .......... .......... .......... 5% 103M 2s 2020-04-28T12:54:56.794 INFO:teuthology.orchestra.run.smithi026.stderr: 4900K .......... .......... .......... .......... .......... 5% 79.4M 2s 2020-04-28T12:54:56.794 INFO:teuthology.orchestra.run.smithi026.stderr: 4950K .......... .......... .......... .......... .......... 5% 107M 2s 2020-04-28T12:54:56.794 INFO:teuthology.orchestra.run.smithi026.stderr: 5000K .......... .......... .......... .......... .......... 5% 62.4M 2s 2020-04-28T12:54:56.795 INFO:teuthology.orchestra.run.smithi026.stderr: 5050K .......... .......... .......... .......... .......... 5% 76.5M 2s 2020-04-28T12:54:56.795 INFO:teuthology.orchestra.run.smithi026.stderr: 5100K .......... .......... .......... .......... .......... 5% 102M 2s 2020-04-28T12:54:56.795 INFO:teuthology.orchestra.run.smithi026.stderr: 5150K .......... .......... .......... .......... .......... 5% 95.2M 2s 2020-04-28T12:54:56.795 INFO:teuthology.orchestra.run.smithi026.stderr: 5200K .......... .......... .......... .......... .......... 5% 105M 2s 2020-04-28T12:54:56.795 INFO:teuthology.orchestra.run.smithi026.stderr: 5250K .......... .......... .......... .......... .......... 5% 117M 2s 2020-04-28T12:54:56.795 INFO:teuthology.orchestra.run.smithi026.stderr: 5300K .......... .......... .......... .......... .......... 5% 83.4M 2s 2020-04-28T12:54:56.795 INFO:teuthology.orchestra.run.smithi026.stderr: 5350K .......... .......... .......... .......... .......... 5% 90.4M 2s 2020-04-28T12:54:56.796 INFO:teuthology.orchestra.run.smithi026.stderr: 5400K .......... .......... .......... .......... .......... 5% 129M 2s 2020-04-28T12:54:56.796 INFO:teuthology.orchestra.run.smithi026.stderr: 5450K .......... .......... .......... .......... .......... 5% 112M 2s 2020-04-28T12:54:56.796 INFO:teuthology.orchestra.run.smithi026.stderr: 5500K .......... .......... .......... .......... .......... 5% 91.1M 2s 2020-04-28T12:54:56.796 INFO:teuthology.orchestra.run.smithi026.stderr: 5550K .......... .......... .......... .......... .......... 6% 84.1M 2s 2020-04-28T12:54:56.796 INFO:teuthology.orchestra.run.smithi026.stderr: 5600K .......... .......... .......... .......... .......... 6% 116M 2s 2020-04-28T12:54:56.796 INFO:teuthology.orchestra.run.smithi026.stderr: 5650K .......... .......... .......... .......... .......... 6% 112M 2s 2020-04-28T12:54:56.797 INFO:teuthology.orchestra.run.smithi026.stderr: 5700K .......... .......... .......... .......... .......... 6% 118M 2s 2020-04-28T12:54:56.797 INFO:teuthology.orchestra.run.smithi026.stderr: 5750K .......... .......... .......... .......... .......... 6% 102M 2s 2020-04-28T12:54:56.797 INFO:teuthology.orchestra.run.smithi026.stderr: 5800K .......... .......... .......... .......... .......... 6% 60.0M 2s 2020-04-28T12:54:56.797 INFO:teuthology.orchestra.run.smithi026.stderr: 5850K .......... .......... .......... .......... .......... 6% 111M 2s 2020-04-28T12:54:56.797 INFO:teuthology.orchestra.run.smithi026.stderr: 5900K .......... .......... .......... .......... .......... 6% 102M 2s 2020-04-28T12:54:56.797 INFO:teuthology.orchestra.run.smithi026.stderr: 5950K .......... .......... .......... .......... .......... 6% 93.3M 2s 2020-04-28T12:54:56.797 INFO:teuthology.orchestra.run.smithi026.stderr: 6000K .......... .......... .......... .......... .......... 6% 113M 2s 2020-04-28T12:54:56.798 INFO:teuthology.orchestra.run.smithi026.stderr: 6050K .......... .......... .......... .......... .......... 6% 85.1M 2s 2020-04-28T12:54:56.798 INFO:teuthology.orchestra.run.smithi026.stderr: 6100K .......... .......... .......... .......... .......... 6% 63.2M 2s 2020-04-28T12:54:56.798 INFO:teuthology.orchestra.run.smithi026.stderr: 6150K .......... .......... .......... .......... .......... 6% 88.6M 2s 2020-04-28T12:54:56.798 INFO:teuthology.orchestra.run.smithi026.stderr: 6200K .......... .......... .......... .......... .......... 6% 106M 2s 2020-04-28T12:54:56.799 INFO:teuthology.orchestra.run.smithi026.stderr: 6250K .......... .......... .......... .......... .......... 6% 126M 2s 2020-04-28T12:54:56.799 INFO:teuthology.orchestra.run.smithi026.stderr: 6300K .......... .......... .......... .......... .......... 6% 118M 2s 2020-04-28T12:54:56.799 INFO:teuthology.orchestra.run.smithi026.stderr: 6350K .......... .......... .......... .......... .......... 6% 67.5M 2s 2020-04-28T12:54:56.799 INFO:teuthology.orchestra.run.smithi026.stderr: 6400K .......... .......... .......... .......... .......... 6% 105M 2s 2020-04-28T12:54:56.799 INFO:teuthology.orchestra.run.smithi026.stderr: 6450K .......... .......... .......... .......... .......... 6% 117M 2s 2020-04-28T12:54:56.799 INFO:teuthology.orchestra.run.smithi026.stderr: 6500K .......... .......... .......... .......... .......... 7% 116M 2s 2020-04-28T12:54:56.800 INFO:teuthology.orchestra.run.smithi026.stderr: 6550K .......... .......... .......... .......... .......... 7% 108M 2s 2020-04-28T12:54:56.800 INFO:teuthology.orchestra.run.smithi026.stderr: 6600K .......... .......... .......... .......... .......... 7% 105M 2s 2020-04-28T12:54:56.800 INFO:teuthology.orchestra.run.smithi026.stderr: 6650K .......... .......... .......... .......... .......... 7% 127M 2s 2020-04-28T12:54:56.800 INFO:teuthology.orchestra.run.smithi026.stderr: 6700K .......... .......... .......... .......... .......... 7% 101M 2s 2020-04-28T12:54:56.800 INFO:teuthology.orchestra.run.smithi026.stderr: 6750K .......... .......... .......... .......... .......... 7% 90.5M 2s 2020-04-28T12:54:56.800 INFO:teuthology.orchestra.run.smithi026.stderr: 6800K .......... .......... .......... .......... .......... 7% 116M 2s 2020-04-28T12:54:56.800 INFO:teuthology.orchestra.run.smithi026.stderr: 6850K .......... .......... .......... .......... .......... 7% 145M 2s 2020-04-28T12:54:56.801 INFO:teuthology.orchestra.run.smithi026.stderr: 6900K .......... .......... .......... .......... .......... 7% 102M 2s 2020-04-28T12:54:56.801 INFO:teuthology.orchestra.run.smithi026.stderr: 6950K .......... .......... .......... .......... .......... 7% 114M 2s 2020-04-28T12:54:56.801 INFO:teuthology.orchestra.run.smithi026.stderr: 7000K .......... .......... .......... .......... .......... 7% 136M 2s 2020-04-28T12:54:56.801 INFO:teuthology.orchestra.run.smithi026.stderr: 7050K .......... .......... .......... .......... .......... 7% 114M 2s 2020-04-28T12:54:56.801 INFO:teuthology.orchestra.run.smithi026.stderr: 7100K .......... .......... .......... .......... .......... 7% 114M 2s 2020-04-28T12:54:56.801 INFO:teuthology.orchestra.run.smithi026.stderr: 7150K .......... .......... .......... .......... .......... 7% 90.3M 2s 2020-04-28T12:54:56.802 INFO:teuthology.orchestra.run.smithi026.stderr: 7200K .......... .......... .......... .......... .......... 7% 114M 2s 2020-04-28T12:54:56.802 INFO:teuthology.orchestra.run.smithi026.stderr: 7250K .......... .......... .......... .......... .......... 7% 120M 2s 2020-04-28T12:54:56.802 INFO:teuthology.orchestra.run.smithi026.stderr: 7300K .......... .......... .......... .......... .......... 7% 116M 2s 2020-04-28T12:54:56.802 INFO:teuthology.orchestra.run.smithi026.stderr: 7350K .......... .......... .......... .......... .......... 7% 111M 2s 2020-04-28T12:54:56.802 INFO:teuthology.orchestra.run.smithi026.stderr: 7400K .......... .......... .......... .......... .......... 8% 118M 2s 2020-04-28T12:54:56.802 INFO:teuthology.orchestra.run.smithi026.stderr: 7450K .......... .......... .......... .......... .......... 8% 112M 2s 2020-04-28T12:54:56.802 INFO:teuthology.orchestra.run.smithi026.stderr: 7500K .......... .......... .......... .......... .......... 8% 116M 2s 2020-04-28T12:54:56.803 INFO:teuthology.orchestra.run.smithi026.stderr: 7550K .......... .......... .......... .......... .......... 8% 91.2M 2s 2020-04-28T12:54:56.803 INFO:teuthology.orchestra.run.smithi026.stderr: 7600K .......... .......... .......... .......... .......... 8% 114M 2s 2020-04-28T12:54:56.803 INFO:teuthology.orchestra.run.smithi026.stderr: 7650K .......... .......... .......... .......... .......... 8% 118M 2s 2020-04-28T12:54:56.803 INFO:teuthology.orchestra.run.smithi026.stderr: 7700K .......... .......... .......... .......... .......... 8% 110M 2s 2020-04-28T12:54:56.803 INFO:teuthology.orchestra.run.smithi026.stderr: 7750K .......... .......... .......... .......... .......... 8% 111M 2s 2020-04-28T12:54:56.803 INFO:teuthology.orchestra.run.smithi026.stderr: 7800K .......... .......... .......... .......... .......... 8% 123M 2s 2020-04-28T12:54:56.804 INFO:teuthology.orchestra.run.smithi026.stderr: 7850K .......... .......... .......... .......... .......... 8% 107M 2s 2020-04-28T12:54:56.804 INFO:teuthology.orchestra.run.smithi026.stderr: 7900K .......... .......... .......... .......... .......... 8% 129M 2s 2020-04-28T12:54:56.804 INFO:teuthology.orchestra.run.smithi026.stderr: 7950K .......... .......... .......... .......... .......... 8% 88.0M 2s 2020-04-28T12:54:56.804 INFO:teuthology.orchestra.run.smithi026.stderr: 8000K .......... .......... .......... .......... .......... 8% 120M 2s 2020-04-28T12:54:56.804 INFO:teuthology.orchestra.run.smithi026.stderr: 8050K .......... .......... .......... .......... .......... 8% 113M 2s 2020-04-28T12:54:56.804 INFO:teuthology.orchestra.run.smithi026.stderr: 8100K .......... .......... .......... .......... .......... 8% 121M 2s 2020-04-28T12:54:56.805 INFO:teuthology.orchestra.run.smithi026.stderr: 8150K .......... .......... .......... .......... .......... 8% 113M 2s 2020-04-28T12:54:56.805 INFO:teuthology.orchestra.run.smithi026.stderr: 8200K .......... .......... .......... .......... .......... 8% 117M 2s 2020-04-28T12:54:56.805 INFO:teuthology.orchestra.run.smithi026.stderr: 8250K .......... .......... .......... .......... .......... 8% 112M 2s 2020-04-28T12:54:56.805 INFO:teuthology.orchestra.run.smithi026.stderr: 8300K .......... .......... .......... .......... .......... 8% 113M 2s 2020-04-28T12:54:56.805 INFO:teuthology.orchestra.run.smithi026.stderr: 8350K .......... .......... .......... .......... .......... 9% 91.2M 2s 2020-04-28T12:54:56.806 INFO:teuthology.orchestra.run.smithi026.stderr: 8400K .......... .......... .......... .......... .......... 9% 120M 2s 2020-04-28T12:54:56.806 INFO:teuthology.orchestra.run.smithi026.stderr: 8450K .......... .......... .......... .......... .......... 9% 118M 2s 2020-04-28T12:54:56.806 INFO:teuthology.orchestra.run.smithi026.stderr: 8500K .......... .......... .......... .......... .......... 9% 117M 2s 2020-04-28T12:54:56.806 INFO:teuthology.orchestra.run.smithi026.stderr: 8550K .......... .......... .......... .......... .......... 9% 106M 2s 2020-04-28T12:54:56.806 INFO:teuthology.orchestra.run.smithi026.stderr: 8600K .......... .......... .......... .......... .......... 9% 127M 2s 2020-04-28T12:54:56.806 INFO:teuthology.orchestra.run.smithi026.stderr: 8650K .......... .......... .......... .......... .......... 9% 116M 2s 2020-04-28T12:54:56.807 INFO:teuthology.orchestra.run.smithi026.stderr: 8700K .......... .......... .......... .......... .......... 9% 114M 2s 2020-04-28T12:54:56.807 INFO:teuthology.orchestra.run.smithi026.stderr: 8750K .......... .......... .......... .......... .......... 9% 94.6M 2s 2020-04-28T12:54:56.807 INFO:teuthology.orchestra.run.smithi026.stderr: 8800K .......... .......... .......... .......... .......... 9% 103M 2s 2020-04-28T12:54:56.807 INFO:teuthology.orchestra.run.smithi026.stderr: 8850K .......... .......... .......... .......... .......... 9% 114M 2s 2020-04-28T12:54:56.807 INFO:teuthology.orchestra.run.smithi026.stderr: 8900K .......... .......... .......... .......... .......... 9% 126M 2s 2020-04-28T12:54:56.807 INFO:teuthology.orchestra.run.smithi026.stderr: 8950K .......... .......... .......... .......... .......... 9% 102M 2s 2020-04-28T12:54:56.807 INFO:teuthology.orchestra.run.smithi026.stderr: 9000K .......... .......... .......... .......... .......... 9% 115M 2s 2020-04-28T12:54:56.808 INFO:teuthology.orchestra.run.smithi026.stderr: 9050K .......... .......... .......... .......... .......... 9% 124M 2s 2020-04-28T12:54:56.808 INFO:teuthology.orchestra.run.smithi026.stderr: 9100K .......... .......... .......... .......... .......... 9% 107M 1s 2020-04-28T12:54:56.808 INFO:teuthology.orchestra.run.smithi026.stderr: 9150K .......... .......... .......... .......... .......... 9% 94.3M 1s 2020-04-28T12:54:56.808 INFO:teuthology.orchestra.run.smithi026.stderr: 9200K .......... .......... .......... .......... .......... 9% 116M 1s 2020-04-28T12:54:56.809 INFO:teuthology.orchestra.run.smithi026.stderr: 9250K .......... .......... .......... .......... .......... 10% 64.3M 1s 2020-04-28T12:54:56.809 INFO:teuthology.orchestra.run.smithi026.stderr: 9300K .......... .......... .......... .......... .......... 10% 91.7M 1s 2020-04-28T12:54:56.809 INFO:teuthology.orchestra.run.smithi026.stderr: 9350K .......... .......... .......... .......... .......... 10% 58.7M 1s 2020-04-28T12:54:56.809 INFO:teuthology.orchestra.run.smithi026.stderr: 9400K .......... .......... .......... .......... .......... 10% 114M 1s 2020-04-28T12:54:56.809 INFO:teuthology.orchestra.run.smithi026.stderr: 9450K .......... .......... .......... .......... .......... 10% 103M 1s 2020-04-28T12:54:56.809 INFO:teuthology.orchestra.run.smithi026.stderr: 9500K .......... .......... .......... .......... .......... 10% 66.1M 1s 2020-04-28T12:54:56.810 INFO:teuthology.orchestra.run.smithi026.stderr: 9550K .......... .......... .......... .......... .......... 10% 80.5M 1s 2020-04-28T12:54:56.810 INFO:teuthology.orchestra.run.smithi026.stderr: 9600K .......... .......... .......... .......... .......... 10% 66.5M 1s 2020-04-28T12:54:56.810 INFO:teuthology.orchestra.run.smithi026.stderr: 9650K .......... .......... .......... .......... .......... 10% 107M 1s 2020-04-28T12:54:56.810 INFO:teuthology.orchestra.run.smithi026.stderr: 9700K .......... .......... .......... .......... .......... 10% 128M 1s 2020-04-28T12:54:56.810 INFO:teuthology.orchestra.run.smithi026.stderr: 9750K .......... .......... .......... .......... .......... 10% 52.4M 1s 2020-04-28T12:54:56.810 INFO:teuthology.orchestra.run.smithi026.stderr: 9800K .......... .......... .......... .......... .......... 10% 61.9M 1s 2020-04-28T12:54:56.810 INFO:teuthology.orchestra.run.smithi026.stderr: 9850K .......... .......... .......... .......... .......... 10% 156M 1s 2020-04-28T12:54:56.811 INFO:teuthology.orchestra.run.smithi026.stderr: 9900K .......... .......... .......... .......... .......... 10% 148M 1s 2020-04-28T12:54:56.811 INFO:teuthology.orchestra.run.smithi026.stderr: 9950K .......... .......... .......... .......... .......... 10% 64.2M 1s 2020-04-28T12:54:56.811 INFO:teuthology.orchestra.run.smithi026.stderr: 10000K .......... .......... .......... .......... .......... 10% 90.6M 1s 2020-04-28T12:54:56.811 INFO:teuthology.orchestra.run.smithi026.stderr: 10050K .......... .......... .......... .......... .......... 10% 65.7M 1s 2020-04-28T12:54:56.811 INFO:teuthology.orchestra.run.smithi026.stderr: 10100K .......... .......... .......... .......... .......... 10% 107M 1s 2020-04-28T12:54:56.811 INFO:teuthology.orchestra.run.smithi026.stderr: 10150K .......... .......... .......... .......... .......... 10% 116M 1s 2020-04-28T12:54:56.812 INFO:teuthology.orchestra.run.smithi026.stderr: 10200K .......... .......... .......... .......... .......... 11% 84.0M 1s 2020-04-28T12:54:56.812 INFO:teuthology.orchestra.run.smithi026.stderr: 10250K .......... .......... .......... .......... .......... 11% 65.8M 1s 2020-04-28T12:54:56.812 INFO:teuthology.orchestra.run.smithi026.stderr: 10300K .......... .......... .......... .......... .......... 11% 100M 1s 2020-04-28T12:54:56.812 INFO:teuthology.orchestra.run.smithi026.stderr: 10350K .......... .......... .......... .......... .......... 11% 57.2M 1s 2020-04-28T12:54:56.812 INFO:teuthology.orchestra.run.smithi026.stderr: 10400K .......... .......... .......... .......... .......... 11% 121M 1s 2020-04-28T12:54:56.812 INFO:teuthology.orchestra.run.smithi026.stderr: 10450K .......... .......... .......... .......... .......... 11% 116M 1s 2020-04-28T12:54:56.813 INFO:teuthology.orchestra.run.smithi026.stderr: 10500K .......... .......... .......... .......... .......... 11% 76.5M 1s 2020-04-28T12:54:56.813 INFO:teuthology.orchestra.run.smithi026.stderr: 10550K .......... .......... .......... .......... .......... 11% 55.2M 1s 2020-04-28T12:54:56.813 INFO:teuthology.orchestra.run.smithi026.stderr: 10600K .......... .......... .......... .......... .......... 11% 184M 1s 2020-04-28T12:54:56.813 INFO:teuthology.orchestra.run.smithi026.stderr: 10650K .......... .......... .......... .......... .......... 11% 103M 1s 2020-04-28T12:54:56.813 INFO:teuthology.orchestra.run.smithi026.stderr: 10700K .......... .......... .......... .......... .......... 11% 69.0M 1s 2020-04-28T12:54:56.813 INFO:teuthology.orchestra.run.smithi026.stderr: 10750K .......... .......... .......... .......... .......... 11% 71.7M 1s 2020-04-28T12:54:56.813 INFO:teuthology.orchestra.run.smithi026.stderr: 10800K .......... .......... .......... .......... .......... 11% 61.8M 1s 2020-04-28T12:54:56.814 INFO:teuthology.orchestra.run.smithi026.stderr: 10850K .......... .......... .......... .......... .......... 11% 134M 1s 2020-04-28T12:54:56.814 INFO:teuthology.orchestra.run.smithi026.stderr: 10900K .......... .......... .......... .......... .......... 11% 106M 1s 2020-04-28T12:54:56.814 INFO:teuthology.orchestra.run.smithi026.stderr: 10950K .......... .......... .......... .......... .......... 11% 61.5M 1s 2020-04-28T12:54:56.814 INFO:teuthology.orchestra.run.smithi026.stderr: 11000K .......... .......... .......... .......... .......... 11% 101M 1s 2020-04-28T12:54:56.814 INFO:teuthology.orchestra.run.smithi026.stderr: 11050K .......... .......... .......... .......... .......... 11% 91.2M 1s 2020-04-28T12:54:56.814 INFO:teuthology.orchestra.run.smithi026.stderr: 11100K .......... .......... .......... .......... .......... 12% 118M 1s 2020-04-28T12:54:56.815 INFO:teuthology.orchestra.run.smithi026.stderr: 11150K .......... .......... .......... .......... .......... 12% 54.3M 1s 2020-04-28T12:54:56.815 INFO:teuthology.orchestra.run.smithi026.stderr: 11200K .......... .......... .......... .......... .......... 12% 114M 1s 2020-04-28T12:54:56.815 INFO:teuthology.orchestra.run.smithi026.stderr: 11250K .......... .......... .......... .......... .......... 12% 49.7M 1s 2020-04-28T12:54:56.815 INFO:teuthology.orchestra.run.smithi026.stderr: 11300K .......... .......... .......... .......... .......... 12% 194M 1s 2020-04-28T12:54:56.815 INFO:teuthology.orchestra.run.smithi026.stderr: 11350K .......... .......... .......... .......... .......... 12% 109M 1s 2020-04-28T12:54:56.815 INFO:teuthology.orchestra.run.smithi026.stderr: 11400K .......... .......... .......... .......... .......... 12% 88.1M 1s 2020-04-28T12:54:56.816 INFO:teuthology.orchestra.run.smithi026.stderr: 11450K .......... .......... .......... .......... .......... 12% 66.8M 1s 2020-04-28T12:54:56.816 INFO:teuthology.orchestra.run.smithi026.stderr: 11500K .......... .......... .......... .......... .......... 12% 119M 1s 2020-04-28T12:54:56.816 INFO:teuthology.orchestra.run.smithi026.stderr: 11550K .......... .......... .......... .......... .......... 12% 50.6M 1s 2020-04-28T12:54:56.816 INFO:teuthology.orchestra.run.smithi026.stderr: 11600K .......... .......... .......... .......... .......... 12% 119M 1s 2020-04-28T12:54:56.816 INFO:teuthology.orchestra.run.smithi026.stderr: 11650K .......... .......... .......... .......... .......... 12% 119M 1s 2020-04-28T12:54:56.816 INFO:teuthology.orchestra.run.smithi026.stderr: 11700K .......... .......... .......... .......... .......... 12% 86.9M 1s 2020-04-28T12:54:56.816 INFO:teuthology.orchestra.run.smithi026.stderr: 11750K .......... .......... .......... .......... .......... 12% 63.4M 1s 2020-04-28T12:54:56.817 INFO:teuthology.orchestra.run.smithi026.stderr: 11800K .......... .......... .......... .......... .......... 12% 96.8M 1s 2020-04-28T12:54:56.817 INFO:teuthology.orchestra.run.smithi026.stderr: 11850K .......... .......... .......... .......... .......... 12% 118M 1s 2020-04-28T12:54:56.817 INFO:teuthology.orchestra.run.smithi026.stderr: 11900K .......... .......... .......... .......... .......... 12% 65.7M 1s 2020-04-28T12:54:56.817 INFO:teuthology.orchestra.run.smithi026.stderr: 11950K .......... .......... .......... .......... .......... 12% 90.6M 1s 2020-04-28T12:54:56.817 INFO:teuthology.orchestra.run.smithi026.stderr: 12000K .......... .......... .......... .......... .......... 12% 64.7M 1s 2020-04-28T12:54:56.817 INFO:teuthology.orchestra.run.smithi026.stderr: 12050K .......... .......... .......... .......... .......... 13% 77.6M 1s 2020-04-28T12:54:56.818 INFO:teuthology.orchestra.run.smithi026.stderr: 12100K .......... .......... .......... .......... .......... 13% 114M 1s 2020-04-28T12:54:56.818 INFO:teuthology.orchestra.run.smithi026.stderr: 12150K .......... .......... .......... .......... .......... 13% 82.0M 1s 2020-04-28T12:54:56.818 INFO:teuthology.orchestra.run.smithi026.stderr: 12200K .......... .......... .......... .......... .......... 13% 68.1M 1s 2020-04-28T12:54:56.818 INFO:teuthology.orchestra.run.smithi026.stderr: 12250K .......... .......... .......... .......... .......... 13% 120M 1s 2020-04-28T12:54:56.818 INFO:teuthology.orchestra.run.smithi026.stderr: 12300K .......... .......... .......... .......... .......... 13% 107M 1s 2020-04-28T12:54:56.818 INFO:teuthology.orchestra.run.smithi026.stderr: 12350K .......... .......... .......... .......... .......... 13% 48.8M 1s 2020-04-28T12:54:56.819 INFO:teuthology.orchestra.run.smithi026.stderr: 12400K .......... .......... .......... .......... .......... 13% 75.3M 1s 2020-04-28T12:54:56.819 INFO:teuthology.orchestra.run.smithi026.stderr: 12450K .......... .......... .......... .......... .......... 13% 64.9M 1s 2020-04-28T12:54:56.819 INFO:teuthology.orchestra.run.smithi026.stderr: 12500K .......... .......... .......... .......... .......... 13% 98.2M 1s 2020-04-28T12:54:56.819 INFO:teuthology.orchestra.run.smithi026.stderr: 12550K .......... .......... .......... .......... .......... 13% 113M 1s 2020-04-28T12:54:56.819 INFO:teuthology.orchestra.run.smithi026.stderr: 12600K .......... .......... .......... .......... .......... 13% 73.8M 1s 2020-04-28T12:54:56.820 INFO:teuthology.orchestra.run.smithi026.stderr: 12650K .......... .......... .......... .......... .......... 13% 64.3M 1s 2020-04-28T12:54:56.820 INFO:teuthology.orchestra.run.smithi026.stderr: 12700K .......... .......... .......... .......... .......... 13% 74.5M 1s 2020-04-28T12:54:56.820 INFO:teuthology.orchestra.run.smithi026.stderr: 12750K .......... .......... .......... .......... .......... 13% 56.0M 1s 2020-04-28T12:54:56.820 INFO:teuthology.orchestra.run.smithi026.stderr: 12800K .......... .......... .......... .......... .......... 13% 76.5M 1s 2020-04-28T12:54:56.820 INFO:teuthology.orchestra.run.smithi026.stderr: 12850K .......... .......... .......... .......... .......... 13% 115M 1s 2020-04-28T12:54:56.820 INFO:teuthology.orchestra.run.smithi026.stderr: 12900K .......... .......... .......... .......... .......... 13% 66.2M 1s 2020-04-28T12:54:56.821 INFO:teuthology.orchestra.run.smithi026.stderr: 12950K .......... .......... .......... .......... .......... 13% 110M 1s 2020-04-28T12:54:56.821 INFO:teuthology.orchestra.run.smithi026.stderr: 13000K .......... .......... .......... .......... .......... 14% 50.2M 1s 2020-04-28T12:54:56.821 INFO:teuthology.orchestra.run.smithi026.stderr: 13050K .......... .......... .......... .......... .......... 14% 122M 1s 2020-04-28T12:54:56.821 INFO:teuthology.orchestra.run.smithi026.stderr: 13100K .......... .......... .......... .......... .......... 14% 111M 1s 2020-04-28T12:54:56.821 INFO:teuthology.orchestra.run.smithi026.stderr: 13150K .......... .......... .......... .......... .......... 14% 64.7M 1s 2020-04-28T12:54:56.821 INFO:teuthology.orchestra.run.smithi026.stderr: 13200K .......... .......... .......... .......... .......... 14% 67.1M 1s 2020-04-28T12:54:56.822 INFO:teuthology.orchestra.run.smithi026.stderr: 13250K .......... .......... .......... .......... .......... 14% 70.6M 1s 2020-04-28T12:54:56.822 INFO:teuthology.orchestra.run.smithi026.stderr: 13300K .......... .......... .......... .......... .......... 14% 124M 1s 2020-04-28T12:54:56.822 INFO:teuthology.orchestra.run.smithi026.stderr: 13350K .......... .......... .......... .......... .......... 14% 65.3M 1s 2020-04-28T12:54:56.822 INFO:teuthology.orchestra.run.smithi026.stderr: 13400K .......... .......... .......... .......... .......... 14% 68.5M 1s 2020-04-28T12:54:56.822 INFO:teuthology.orchestra.run.smithi026.stderr: 13450K .......... .......... .......... .......... .......... 14% 126M 1s 2020-04-28T12:54:56.822 INFO:teuthology.orchestra.run.smithi026.stderr: 13500K .......... .......... .......... .......... .......... 14% 66.8M 1s 2020-04-28T12:54:56.822 INFO:teuthology.orchestra.run.smithi026.stderr: 13550K .......... .......... .......... .......... .......... 14% 61.8M 1s 2020-04-28T12:54:56.823 INFO:teuthology.orchestra.run.smithi026.stderr: 13600K .......... .......... .......... .......... .......... 14% 106M 1s 2020-04-28T12:54:56.823 INFO:teuthology.orchestra.run.smithi026.stderr: 13650K .......... .......... .......... .......... .......... 14% 71.5M 1s 2020-04-28T12:54:56.823 INFO:teuthology.orchestra.run.smithi026.stderr: 13700K .......... .......... .......... .......... .......... 14% 74.1M 1s 2020-04-28T12:54:56.823 INFO:teuthology.orchestra.run.smithi026.stderr: 13750K .......... .......... .......... .......... .......... 14% 57.1M 1s 2020-04-28T12:54:56.823 INFO:teuthology.orchestra.run.smithi026.stderr: 13800K .......... .......... .......... .......... .......... 14% 122M 1s 2020-04-28T12:54:56.823 INFO:teuthology.orchestra.run.smithi026.stderr: 13850K .......... .......... .......... .......... .......... 14% 80.4M 1s 2020-04-28T12:54:56.824 INFO:teuthology.orchestra.run.smithi026.stderr: 13900K .......... .......... .......... .......... .......... 15% 60.8M 1s 2020-04-28T12:54:56.824 INFO:teuthology.orchestra.run.smithi026.stderr: 13950K .......... .......... .......... .......... .......... 15% 71.5M 1s 2020-04-28T12:54:56.824 INFO:teuthology.orchestra.run.smithi026.stderr: 14000K .......... .......... .......... .......... .......... 15% 59.2M 1s 2020-04-28T12:54:56.824 INFO:teuthology.orchestra.run.smithi026.stderr: 14050K .......... .......... .......... .......... .......... 15% 119M 1s 2020-04-28T12:54:56.824 INFO:teuthology.orchestra.run.smithi026.stderr: 14100K .......... .......... .......... .......... .......... 15% 85.4M 1s 2020-04-28T12:54:56.824 INFO:teuthology.orchestra.run.smithi026.stderr: 14150K .......... .......... .......... .......... .......... 15% 56.2M 1s 2020-04-28T12:54:56.824 INFO:teuthology.orchestra.run.smithi026.stderr: 14200K .......... .......... .......... .......... .......... 15% 88.1M 1s 2020-04-28T12:54:56.825 INFO:teuthology.orchestra.run.smithi026.stderr: 14250K .......... .......... .......... .......... .......... 15% 82.4M 1s 2020-04-28T12:54:56.825 INFO:teuthology.orchestra.run.smithi026.stderr: 14300K .......... .......... .......... .......... .......... 15% 61.5M 1s 2020-04-28T12:54:56.825 INFO:teuthology.orchestra.run.smithi026.stderr: 14350K .......... .......... .......... .......... .......... 15% 52.7M 1s 2020-04-28T12:54:56.825 INFO:teuthology.orchestra.run.smithi026.stderr: 14400K .......... .......... .......... .......... .......... 15% 108M 1s 2020-04-28T12:54:56.825 INFO:teuthology.orchestra.run.smithi026.stderr: 14450K .......... .......... .......... .......... .......... 15% 51.2M 1s 2020-04-28T12:54:56.825 INFO:teuthology.orchestra.run.smithi026.stderr: 14500K .......... .......... .......... .......... .......... 15% 115M 1s 2020-04-28T12:54:56.826 INFO:teuthology.orchestra.run.smithi026.stderr: 14550K .......... .......... .......... .......... .......... 15% 114M 1s 2020-04-28T12:54:56.826 INFO:teuthology.orchestra.run.smithi026.stderr: 14600K .......... .......... .......... .......... .......... 15% 49.8M 1s 2020-04-28T12:54:56.826 INFO:teuthology.orchestra.run.smithi026.stderr: 14650K .......... .......... .......... .......... .......... 15% 83.9M 1s 2020-04-28T12:54:56.826 INFO:teuthology.orchestra.run.smithi026.stderr: 14700K .......... .......... .......... .......... .......... 15% 61.0M 1s 2020-04-28T12:54:56.826 INFO:teuthology.orchestra.run.smithi026.stderr: 14750K .......... .......... .......... .......... .......... 15% 68.2M 1s 2020-04-28T12:54:56.826 INFO:teuthology.orchestra.run.smithi026.stderr: 14800K .......... .......... .......... .......... .......... 15% 120M 1s 2020-04-28T12:54:56.827 INFO:teuthology.orchestra.run.smithi026.stderr: 14850K .......... .......... .......... .......... .......... 16% 59.0M 1s 2020-04-28T12:54:56.827 INFO:teuthology.orchestra.run.smithi026.stderr: 14900K .......... .......... .......... .......... .......... 16% 81.5M 1s 2020-04-28T12:54:56.827 INFO:teuthology.orchestra.run.smithi026.stderr: 14950K .......... .......... .......... .......... .......... 16% 76.0M 1s 2020-04-28T12:54:56.827 INFO:teuthology.orchestra.run.smithi026.stderr: 15000K .......... .......... .......... .......... .......... 16% 119M 1s 2020-04-28T12:54:56.827 INFO:teuthology.orchestra.run.smithi026.stderr: 15050K .......... .......... .......... .......... .......... 16% 73.2M 1s 2020-04-28T12:54:56.827 INFO:teuthology.orchestra.run.smithi026.stderr: 15100K .......... .......... .......... .......... .......... 16% 89.9M 1s 2020-04-28T12:54:56.828 INFO:teuthology.orchestra.run.smithi026.stderr: 15150K .......... .......... .......... .......... .......... 16% 65.7M 1s 2020-04-28T12:54:56.828 INFO:teuthology.orchestra.run.smithi026.stderr: 15200K .......... .......... .......... .......... .......... 16% 72.7M 1s 2020-04-28T12:54:56.828 INFO:teuthology.orchestra.run.smithi026.stderr: 15250K .......... .......... .......... .......... .......... 16% 116M 1s 2020-04-28T12:54:56.828 INFO:teuthology.orchestra.run.smithi026.stderr: 15300K .......... .......... .......... .......... .......... 16% 91.9M 1s 2020-04-28T12:54:56.828 INFO:teuthology.orchestra.run.smithi026.stderr: 15350K .......... .......... .......... .......... .......... 16% 74.0M 1s 2020-04-28T12:54:56.828 INFO:teuthology.orchestra.run.smithi026.stderr: 15400K .......... .......... .......... .......... .......... 16% 75.1M 1s 2020-04-28T12:54:56.828 INFO:teuthology.orchestra.run.smithi026.stderr: 15450K .......... .......... .......... .......... .......... 16% 94.1M 1s 2020-04-28T12:54:56.829 INFO:teuthology.orchestra.run.smithi026.stderr: 15500K .......... .......... .......... .......... .......... 16% 82.9M 1s 2020-04-28T12:54:56.829 INFO:teuthology.orchestra.run.smithi026.stderr: 15550K .......... .......... .......... .......... .......... 16% 83.7M 1s 2020-04-28T12:54:56.829 INFO:teuthology.orchestra.run.smithi026.stderr: 15600K .......... .......... .......... .......... .......... 16% 54.0M 1s 2020-04-28T12:54:56.829 INFO:teuthology.orchestra.run.smithi026.stderr: 15650K .......... .......... .......... .......... .......... 16% 91.9M 1s 2020-04-28T12:54:56.830 INFO:teuthology.orchestra.run.smithi026.stderr: 15700K .......... .......... .......... .......... .......... 16% 127M 1s 2020-04-28T12:54:56.830 INFO:teuthology.orchestra.run.smithi026.stderr: 15750K .......... .......... .......... .......... .......... 17% 103M 1s 2020-04-28T12:54:56.830 INFO:teuthology.orchestra.run.smithi026.stderr: 15800K .......... .......... .......... .......... .......... 17% 74.3M 1s 2020-04-28T12:54:56.830 INFO:teuthology.orchestra.run.smithi026.stderr: 15850K .......... .......... .......... .......... .......... 17% 69.3M 1s 2020-04-28T12:54:56.830 INFO:teuthology.orchestra.run.smithi026.stderr: 15900K .......... .......... .......... .......... .......... 17% 75.2M 1s 2020-04-28T12:54:56.830 INFO:teuthology.orchestra.run.smithi026.stderr: 15950K .......... .......... .......... .......... .......... 17% 91.1M 1s 2020-04-28T12:54:56.831 INFO:teuthology.orchestra.run.smithi026.stderr: 16000K .......... .......... .......... .......... .......... 17% 63.5M 1s 2020-04-28T12:54:56.831 INFO:teuthology.orchestra.run.smithi026.stderr: 16050K .......... .......... .......... .......... .......... 17% 125M 1s 2020-04-28T12:54:56.831 INFO:teuthology.orchestra.run.smithi026.stderr: 16100K .......... .......... .......... .......... .......... 17% 74.0M 1s 2020-04-28T12:54:56.831 INFO:teuthology.orchestra.run.smithi026.stderr: 16150K .......... .......... .......... .......... .......... 17% 93.2M 1s 2020-04-28T12:54:56.831 INFO:teuthology.orchestra.run.smithi026.stderr: 16200K .......... .......... .......... .......... .......... 17% 74.1M 1s 2020-04-28T12:54:56.831 INFO:teuthology.orchestra.run.smithi026.stderr: 16250K .......... .......... .......... .......... .......... 17% 123M 1s 2020-04-28T12:54:56.831 INFO:teuthology.orchestra.run.smithi026.stderr: 16300K .......... .......... .......... .......... .......... 17% 75.4M 1s 2020-04-28T12:54:56.832 INFO:teuthology.orchestra.run.smithi026.stderr: 16350K .......... .......... .......... .......... .......... 17% 52.1M 1s 2020-04-28T12:54:56.832 INFO:teuthology.orchestra.run.smithi026.stderr: 16400K .......... .......... .......... .......... .......... 17% 107M 1s 2020-04-28T12:54:56.832 INFO:teuthology.orchestra.run.smithi026.stderr: 16450K .......... .......... .......... .......... .......... 17% 75.9M 1s 2020-04-28T12:54:56.832 INFO:teuthology.orchestra.run.smithi026.stderr: 16500K .......... .......... .......... .......... .......... 17% 118M 1s 2020-04-28T12:54:56.832 INFO:teuthology.orchestra.run.smithi026.stderr: 16550K .......... .......... .......... .......... .......... 17% 65.5M 1s 2020-04-28T12:54:56.832 INFO:teuthology.orchestra.run.smithi026.stderr: 16600K .......... .......... .......... .......... .......... 17% 75.1M 1s 2020-04-28T12:54:56.833 INFO:teuthology.orchestra.run.smithi026.stderr: 16650K .......... .......... .......... .......... .......... 17% 64.6M 1s 2020-04-28T12:54:56.833 INFO:teuthology.orchestra.run.smithi026.stderr: 16700K .......... .......... .......... .......... .......... 18% 75.0M 1s 2020-04-28T12:54:56.833 INFO:teuthology.orchestra.run.smithi026.stderr: 16750K .......... .......... .......... .......... .......... 18% 43.5M 1s 2020-04-28T12:54:56.833 INFO:teuthology.orchestra.run.smithi026.stderr: 16800K .......... .......... .......... .......... .......... 18% 50.4M 1s 2020-04-28T12:54:56.833 INFO:teuthology.orchestra.run.smithi026.stderr: 16850K .......... .......... .......... .......... .......... 18% 63.6M 1s 2020-04-28T12:54:56.833 INFO:teuthology.orchestra.run.smithi026.stderr: 16900K .......... .......... .......... .......... .......... 18% 49.7M 1s 2020-04-28T12:54:56.833 INFO:teuthology.orchestra.run.smithi026.stderr: 16950K .......... .......... .......... .......... .......... 18% 49.9M 1s 2020-04-28T12:54:56.834 INFO:teuthology.orchestra.run.smithi026.stderr: 17000K .......... .......... .......... .......... .......... 18% 76.1M 1s 2020-04-28T12:54:56.834 INFO:teuthology.orchestra.run.smithi026.stderr: 17050K .......... .......... .......... .......... .......... 18% 67.2M 1s 2020-04-28T12:54:56.834 INFO:teuthology.orchestra.run.smithi026.stderr: 17100K .......... .......... .......... .......... .......... 18% 49.9M 1s 2020-04-28T12:54:56.834 INFO:teuthology.orchestra.run.smithi026.stderr: 17150K .......... .......... .......... .......... .......... 18% 44.0M 1s 2020-04-28T12:54:56.834 INFO:teuthology.orchestra.run.smithi026.stderr: 17200K .......... .......... .......... .......... .......... 18% 49.7M 1s 2020-04-28T12:54:56.834 INFO:teuthology.orchestra.run.smithi026.stderr: 17250K .......... .......... .......... .......... .......... 18% 69.6M 1s 2020-04-28T12:54:56.835 INFO:teuthology.orchestra.run.smithi026.stderr: 17300K .......... .......... .......... .......... .......... 18% 48.4M 1s 2020-04-28T12:54:56.835 INFO:teuthology.orchestra.run.smithi026.stderr: 17350K .......... .......... .......... .......... .......... 18% 63.7M 1s 2020-04-28T12:54:56.835 INFO:teuthology.orchestra.run.smithi026.stderr: 17400K .......... .......... .......... .......... .......... 18% 50.7M 1s 2020-04-28T12:54:56.835 INFO:teuthology.orchestra.run.smithi026.stderr: 17450K .......... .......... .......... .......... .......... 18% 78.6M 1s 2020-04-28T12:54:56.835 INFO:teuthology.orchestra.run.smithi026.stderr: 17500K .......... .......... .......... .......... .......... 18% 50.0M 1s 2020-04-28T12:54:56.835 INFO:teuthology.orchestra.run.smithi026.stderr: 17550K .......... .......... .......... .......... .......... 18% 90.0M 1s 2020-04-28T12:54:56.836 INFO:teuthology.orchestra.run.smithi026.stderr: 17600K .......... .......... .......... .......... .......... 18% 65.6M 1s 2020-04-28T12:54:56.836 INFO:teuthology.orchestra.run.smithi026.stderr: 17650K .......... .......... .......... .......... .......... 19% 69.1M 1s 2020-04-28T12:54:56.836 INFO:teuthology.orchestra.run.smithi026.stderr: 17700K .......... .......... .......... .......... .......... 19% 125M 1s 2020-04-28T12:54:56.836 INFO:teuthology.orchestra.run.smithi026.stderr: 17750K .......... .......... .......... .......... .......... 19% 100M 1s 2020-04-28T12:54:56.836 INFO:teuthology.orchestra.run.smithi026.stderr: 17800K .......... .......... .......... .......... .......... 19% 72.2M 1s 2020-04-28T12:54:56.836 INFO:teuthology.orchestra.run.smithi026.stderr: 17850K .......... .......... .......... .......... .......... 19% 70.3M 1s 2020-04-28T12:54:56.836 INFO:teuthology.orchestra.run.smithi026.stderr: 17900K .......... .......... .......... .......... .......... 19% 98.6M 1s 2020-04-28T12:54:56.837 INFO:teuthology.orchestra.run.smithi026.stderr: 17950K .......... .......... .......... .......... .......... 19% 63.7M 1s 2020-04-28T12:54:56.837 INFO:teuthology.orchestra.run.smithi026.stderr: 18000K .......... .......... .......... .......... .......... 19% 128M 1s 2020-04-28T12:54:56.837 INFO:teuthology.orchestra.run.smithi026.stderr: 18050K .......... .......... .......... .......... .......... 19% 72.2M 1s 2020-04-28T12:54:56.837 INFO:teuthology.orchestra.run.smithi026.stderr: 18100K .......... .......... .......... .......... .......... 19% 66.5M 1s 2020-04-28T12:54:56.837 INFO:teuthology.orchestra.run.smithi026.stderr: 18150K .......... .......... .......... .......... .......... 19% 108M 1s 2020-04-28T12:54:56.837 INFO:teuthology.orchestra.run.smithi026.stderr: 18200K .......... .......... .......... .......... .......... 19% 123M 1s 2020-04-28T12:54:56.838 INFO:teuthology.orchestra.run.smithi026.stderr: 18250K .......... .......... .......... .......... .......... 19% 74.4M 1s 2020-04-28T12:54:56.838 INFO:teuthology.orchestra.run.smithi026.stderr: 18300K .......... .......... .......... .......... .......... 19% 66.5M 1s 2020-04-28T12:54:56.838 INFO:teuthology.orchestra.run.smithi026.stderr: 18350K .......... .......... .......... .......... .......... 19% 88.1M 1s 2020-04-28T12:54:56.838 INFO:teuthology.orchestra.run.smithi026.stderr: 18400K .......... .......... .......... .......... .......... 19% 75.5M 1s 2020-04-28T12:54:56.838 INFO:teuthology.orchestra.run.smithi026.stderr: 18450K .......... .......... .......... .......... .......... 19% 117M 1s 2020-04-28T12:54:56.838 INFO:teuthology.orchestra.run.smithi026.stderr: 18500K .......... .......... .......... .......... .......... 19% 65.6M 1s 2020-04-28T12:54:56.839 INFO:teuthology.orchestra.run.smithi026.stderr: 18550K .......... .......... .......... .......... .......... 20% 104M 1s 2020-04-28T12:54:56.839 INFO:teuthology.orchestra.run.smithi026.stderr: 18600K .......... .......... .......... .......... .......... 20% 74.4M 1s 2020-04-28T12:54:56.839 INFO:teuthology.orchestra.run.smithi026.stderr: 18650K .......... .......... .......... .......... .......... 20% 68.7M 1s 2020-04-28T12:54:56.839 INFO:teuthology.orchestra.run.smithi026.stderr: 18700K .......... .......... .......... .......... .......... 20% 127M 1s 2020-04-28T12:54:56.839 INFO:teuthology.orchestra.run.smithi026.stderr: 18750K .......... .......... .......... .......... .......... 20% 88.9M 1s 2020-04-28T12:54:56.840 INFO:teuthology.orchestra.run.smithi026.stderr: 18800K .......... .......... .......... .......... .......... 20% 74.9M 1s 2020-04-28T12:54:56.840 INFO:teuthology.orchestra.run.smithi026.stderr: 18850K .......... .......... .......... .......... .......... 20% 68.3M 1s 2020-04-28T12:54:56.840 INFO:teuthology.orchestra.run.smithi026.stderr: 18900K .......... .......... .......... .......... .......... 20% 108M 1s 2020-04-28T12:54:56.840 INFO:teuthology.orchestra.run.smithi026.stderr: 18950K .......... .......... .......... .......... .......... 20% 116M 1s 2020-04-28T12:54:56.840 INFO:teuthology.orchestra.run.smithi026.stderr: 19000K .......... .......... .......... .......... .......... 20% 76.9M 1s 2020-04-28T12:54:56.841 INFO:teuthology.orchestra.run.smithi026.stderr: 19050K .......... .......... .......... .......... .......... 20% 65.5M 1s 2020-04-28T12:54:56.841 INFO:teuthology.orchestra.run.smithi026.stderr: 19100K .......... .......... .......... .......... .......... 20% 117M 1s 2020-04-28T12:54:56.841 INFO:teuthology.orchestra.run.smithi026.stderr: 19150K .......... .......... .......... .......... .......... 20% 63.0M 1s 2020-04-28T12:54:56.841 INFO:teuthology.orchestra.run.smithi026.stderr: 19200K .......... .......... .......... .......... .......... 20% 114M 1s 2020-04-28T12:54:56.841 INFO:teuthology.orchestra.run.smithi026.stderr: 19250K .......... .......... .......... .......... .......... 20% 64.5M 1s 2020-04-28T12:54:56.841 INFO:teuthology.orchestra.run.smithi026.stderr: 19300K .......... .......... .......... .......... .......... 20% 128M 1s 2020-04-28T12:54:56.841 INFO:teuthology.orchestra.run.smithi026.stderr: 19350K .......... .......... .......... .......... .......... 20% 68.9M 1s 2020-04-28T12:54:56.842 INFO:teuthology.orchestra.run.smithi026.stderr: 19400K .......... .......... .......... .......... .......... 20% 65.8M 1s 2020-04-28T12:54:56.842 INFO:teuthology.orchestra.run.smithi026.stderr: 19450K .......... .......... .......... .......... .......... 20% 124M 1s 2020-04-28T12:54:56.842 INFO:teuthology.orchestra.run.smithi026.stderr: 19500K .......... .......... .......... .......... .......... 21% 119M 1s 2020-04-28T12:54:56.842 INFO:teuthology.orchestra.run.smithi026.stderr: 19550K .......... .......... .......... .......... .......... 21% 61.6M 1s 2020-04-28T12:54:56.842 INFO:teuthology.orchestra.run.smithi026.stderr: 19600K .......... .......... .......... .......... .......... 21% 63.8M 1s 2020-04-28T12:54:56.842 INFO:teuthology.orchestra.run.smithi026.stderr: 19650K .......... .......... .......... .......... .......... 21% 130M 1s 2020-04-28T12:54:56.843 INFO:teuthology.orchestra.run.smithi026.stderr: 19700K .......... .......... .......... .......... .......... 21% 119M 1s 2020-04-28T12:54:56.843 INFO:teuthology.orchestra.run.smithi026.stderr: 19750K .......... .......... .......... .......... .......... 21% 71.3M 1s 2020-04-28T12:54:56.843 INFO:teuthology.orchestra.run.smithi026.stderr: 19800K .......... .......... .......... .......... .......... 21% 66.7M 1s 2020-04-28T12:54:56.843 INFO:teuthology.orchestra.run.smithi026.stderr: 19850K .......... .......... .......... .......... .......... 21% 117M 1s 2020-04-28T12:54:56.843 INFO:teuthology.orchestra.run.smithi026.stderr: 19900K .......... .......... .......... .......... .......... 21% 73.4M 1s 2020-04-28T12:54:56.843 INFO:teuthology.orchestra.run.smithi026.stderr: 19950K .......... .......... .......... .......... .......... 21% 92.9M 1s 2020-04-28T12:54:56.844 INFO:teuthology.orchestra.run.smithi026.stderr: 20000K .......... .......... .......... .......... .......... 21% 67.5M 1s 2020-04-28T12:54:56.844 INFO:teuthology.orchestra.run.smithi026.stderr: 20050K .......... .......... .......... .......... .......... 21% 73.7M 1s 2020-04-28T12:54:56.844 INFO:teuthology.orchestra.run.smithi026.stderr: 20100K .......... .......... .......... .......... .......... 21% 118M 1s 2020-04-28T12:54:56.844 INFO:teuthology.orchestra.run.smithi026.stderr: 20150K .......... .......... .......... .......... .......... 21% 107M 1s 2020-04-28T12:54:56.844 INFO:teuthology.orchestra.run.smithi026.stderr: 20200K .......... .......... .......... .......... .......... 21% 68.1M 1s 2020-04-28T12:54:56.844 INFO:teuthology.orchestra.run.smithi026.stderr: 20250K .......... .......... .......... .......... .......... 21% 116M 1s 2020-04-28T12:54:56.844 INFO:teuthology.orchestra.run.smithi026.stderr: 20300K .......... .......... .......... .......... .......... 21% 48.7M 1s 2020-04-28T12:54:56.845 INFO:teuthology.orchestra.run.smithi026.stderr: 20350K .......... .......... .......... .......... .......... 21% 73.5M 1s 2020-04-28T12:54:56.845 INFO:teuthology.orchestra.run.smithi026.stderr: 20400K .......... .......... .......... .......... .......... 22% 52.4M 1s 2020-04-28T12:54:56.845 INFO:teuthology.orchestra.run.smithi026.stderr: 20450K .......... .......... .......... .......... .......... 22% 126M 1s 2020-04-28T12:54:56.845 INFO:teuthology.orchestra.run.smithi026.stderr: 20500K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:54:56.845 INFO:teuthology.orchestra.run.smithi026.stderr: 20550K .......... .......... .......... .......... .......... 22% 73.1M 1s 2020-04-28T12:54:56.845 INFO:teuthology.orchestra.run.smithi026.stderr: 20600K .......... .......... .......... .......... .......... 22% 118M 1s 2020-04-28T12:54:56.845 INFO:teuthology.orchestra.run.smithi026.stderr: 20650K .......... .......... .......... .......... .......... 22% 106M 1s 2020-04-28T12:54:56.846 INFO:teuthology.orchestra.run.smithi026.stderr: 20700K .......... .......... .......... .......... .......... 22% 66.2M 1s 2020-04-28T12:54:56.846 INFO:teuthology.orchestra.run.smithi026.stderr: 20750K .......... .......... .......... .......... .......... 22% 98.3M 1s 2020-04-28T12:54:56.846 INFO:teuthology.orchestra.run.smithi026.stderr: 20800K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:54:56.846 INFO:teuthology.orchestra.run.smithi026.stderr: 20850K .......... .......... .......... .......... .......... 22% 75.0M 1s 2020-04-28T12:54:56.846 INFO:teuthology.orchestra.run.smithi026.stderr: 20900K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:54:56.846 INFO:teuthology.orchestra.run.smithi026.stderr: 20950K .......... .......... .......... .......... .......... 22% 110M 1s 2020-04-28T12:54:56.847 INFO:teuthology.orchestra.run.smithi026.stderr: 21000K .......... .......... .......... .......... .......... 22% 65.6M 1s 2020-04-28T12:54:56.847 INFO:teuthology.orchestra.run.smithi026.stderr: 21050K .......... .......... .......... .......... .......... 22% 116M 1s 2020-04-28T12:54:56.847 INFO:teuthology.orchestra.run.smithi026.stderr: 21100K .......... .......... .......... .......... .......... 22% 101M 1s 2020-04-28T12:54:56.847 INFO:teuthology.orchestra.run.smithi026.stderr: 21150K .......... .......... .......... .......... .......... 22% 65.3M 1s 2020-04-28T12:54:56.847 INFO:teuthology.orchestra.run.smithi026.stderr: 21200K .......... .......... .......... .......... .......... 22% 115M 1s 2020-04-28T12:54:56.847 INFO:teuthology.orchestra.run.smithi026.stderr: 21250K .......... .......... .......... .......... .......... 22% 121M 1s 2020-04-28T12:54:56.847 INFO:teuthology.orchestra.run.smithi026.stderr: 21300K .......... .......... .......... .......... .......... 22% 112M 1s 2020-04-28T12:54:56.848 INFO:teuthology.orchestra.run.smithi026.stderr: 21350K .......... .......... .......... .......... .......... 23% 49.4M 1s 2020-04-28T12:54:56.848 INFO:teuthology.orchestra.run.smithi026.stderr: 21400K .......... .......... .......... .......... .......... 23% 114M 1s 2020-04-28T12:54:56.848 INFO:teuthology.orchestra.run.smithi026.stderr: 21450K .......... .......... .......... .......... .......... 23% 112M 1s 2020-04-28T12:54:56.848 INFO:teuthology.orchestra.run.smithi026.stderr: 21500K .......... .......... .......... .......... .......... 23% 106M 1s 2020-04-28T12:54:56.848 INFO:teuthology.orchestra.run.smithi026.stderr: 21550K .......... .......... .......... .......... .......... 23% 59.7M 1s 2020-04-28T12:54:56.848 INFO:teuthology.orchestra.run.smithi026.stderr: 21600K .......... .......... .......... .......... .......... 23% 72.4M 1s 2020-04-28T12:54:56.849 INFO:teuthology.orchestra.run.smithi026.stderr: 21650K .......... .......... .......... .......... .......... 23% 96.7M 1s 2020-04-28T12:54:56.849 INFO:teuthology.orchestra.run.smithi026.stderr: 21700K .......... .......... .......... .......... .......... 23% 56.5M 1s 2020-04-28T12:54:56.849 INFO:teuthology.orchestra.run.smithi026.stderr: 21750K .......... .......... .......... .......... .......... 23% 97.8M 1s 2020-04-28T12:54:56.849 INFO:teuthology.orchestra.run.smithi026.stderr: 21800K .......... .......... .......... .......... .......... 23% 72.1M 1s 2020-04-28T12:54:56.849 INFO:teuthology.orchestra.run.smithi026.stderr: 21850K .......... .......... .......... .......... .......... 23% 105M 1s 2020-04-28T12:54:56.849 INFO:teuthology.orchestra.run.smithi026.stderr: 21900K .......... .......... .......... .......... .......... 23% 75.9M 1s 2020-04-28T12:54:56.850 INFO:teuthology.orchestra.run.smithi026.stderr: 21950K .......... .......... .......... .......... .......... 23% 58.6M 1s 2020-04-28T12:54:56.850 INFO:teuthology.orchestra.run.smithi026.stderr: 22000K .......... .......... .......... .......... .......... 23% 69.1M 1s 2020-04-28T12:54:56.850 INFO:teuthology.orchestra.run.smithi026.stderr: 22050K .......... .......... .......... .......... .......... 23% 70.7M 1s 2020-04-28T12:54:56.850 INFO:teuthology.orchestra.run.smithi026.stderr: 22100K .......... .......... .......... .......... .......... 23% 111M 1s 2020-04-28T12:54:56.850 INFO:teuthology.orchestra.run.smithi026.stderr: 22150K .......... .......... .......... .......... .......... 23% 106M 1s 2020-04-28T12:54:56.851 INFO:teuthology.orchestra.run.smithi026.stderr: 22200K .......... .......... .......... .......... .......... 23% 77.4M 1s 2020-04-28T12:54:56.851 INFO:teuthology.orchestra.run.smithi026.stderr: 22250K .......... .......... .......... .......... .......... 24% 65.3M 1s 2020-04-28T12:54:56.851 INFO:teuthology.orchestra.run.smithi026.stderr: 22300K .......... .......... .......... .......... .......... 24% 72.0M 1s 2020-04-28T12:54:56.851 INFO:teuthology.orchestra.run.smithi026.stderr: 22350K .......... .......... .......... .......... .......... 24% 58.6M 1s 2020-04-28T12:54:56.851 INFO:teuthology.orchestra.run.smithi026.stderr: 22400K .......... .......... .......... .......... .......... 24% 108M 1s 2020-04-28T12:54:56.851 INFO:teuthology.orchestra.run.smithi026.stderr: 22450K .......... .......... .......... .......... .......... 24% 77.0M 1s 2020-04-28T12:54:56.851 INFO:teuthology.orchestra.run.smithi026.stderr: 22500K .......... .......... .......... .......... .......... 24% 107M 1s 2020-04-28T12:54:56.852 INFO:teuthology.orchestra.run.smithi026.stderr: 22550K .......... .......... .......... .......... .......... 24% 66.8M 1s 2020-04-28T12:54:56.852 INFO:teuthology.orchestra.run.smithi026.stderr: 22600K .......... .......... .......... .......... .......... 24% 110M 1s 2020-04-28T12:54:56.852 INFO:teuthology.orchestra.run.smithi026.stderr: 22650K .......... .......... .......... .......... .......... 24% 74.7M 1s 2020-04-28T12:54:56.852 INFO:teuthology.orchestra.run.smithi026.stderr: 22700K .......... .......... .......... .......... .......... 24% 67.7M 1s 2020-04-28T12:54:56.852 INFO:teuthology.orchestra.run.smithi026.stderr: 22750K .......... .......... .......... .......... .......... 24% 55.9M 1s 2020-04-28T12:54:56.852 INFO:teuthology.orchestra.run.smithi026.stderr: 22800K .......... .......... .......... .......... .......... 24% 71.9M 1s 2020-04-28T12:54:56.853 INFO:teuthology.orchestra.run.smithi026.stderr: 22850K .......... .......... .......... .......... .......... 24% 79.6M 1s 2020-04-28T12:54:56.853 INFO:teuthology.orchestra.run.smithi026.stderr: 22900K .......... .......... .......... .......... .......... 24% 109M 1s 2020-04-28T12:54:56.853 INFO:teuthology.orchestra.run.smithi026.stderr: 22950K .......... .......... .......... .......... .......... 24% 64.2M 1s 2020-04-28T12:54:56.853 INFO:teuthology.orchestra.run.smithi026.stderr: 23000K .......... .......... .......... .......... .......... 24% 73.4M 1s 2020-04-28T12:54:56.853 INFO:teuthology.orchestra.run.smithi026.stderr: 23050K .......... .......... .......... .......... .......... 24% 64.7M 1s 2020-04-28T12:54:56.853 INFO:teuthology.orchestra.run.smithi026.stderr: 23100K .......... .......... .......... .......... .......... 24% 115M 1s 2020-04-28T12:54:56.854 INFO:teuthology.orchestra.run.smithi026.stderr: 23150K .......... .......... .......... .......... .......... 24% 92.3M 1s 2020-04-28T12:54:56.854 INFO:teuthology.orchestra.run.smithi026.stderr: 23200K .......... .......... .......... .......... .......... 25% 73.0M 1s 2020-04-28T12:54:56.854 INFO:teuthology.orchestra.run.smithi026.stderr: 23250K .......... .......... .......... .......... .......... 25% 9.79M 1s 2020-04-28T12:54:56.854 INFO:teuthology.orchestra.run.smithi026.stderr: 23300K .......... .......... .......... .......... .......... 25% 152M 1s 2020-04-28T12:54:56.854 INFO:teuthology.orchestra.run.smithi026.stderr: 23350K .......... .......... .......... .......... .......... 25% 145M 1s 2020-04-28T12:54:56.854 INFO:teuthology.orchestra.run.smithi026.stderr: 23400K .......... .......... .......... .......... .......... 25% 152M 1s 2020-04-28T12:54:56.855 INFO:teuthology.orchestra.run.smithi026.stderr: 23450K .......... .......... .......... .......... .......... 25% 155M 1s 2020-04-28T12:54:56.855 INFO:teuthology.orchestra.run.smithi026.stderr: 23500K .......... .......... .......... .......... .......... 25% 156M 1s 2020-04-28T12:54:56.855 INFO:teuthology.orchestra.run.smithi026.stderr: 23550K .......... .......... .......... .......... .......... 25% 123M 1s 2020-04-28T12:54:56.855 INFO:teuthology.orchestra.run.smithi026.stderr: 23600K .......... .......... .......... .......... .......... 25% 156M 1s 2020-04-28T12:54:56.855 INFO:teuthology.orchestra.run.smithi026.stderr: 23650K .......... .......... .......... .......... .......... 25% 160M 1s 2020-04-28T12:54:56.855 INFO:teuthology.orchestra.run.smithi026.stderr: 23700K .......... .......... .......... .......... .......... 25% 154M 1s 2020-04-28T12:54:56.855 INFO:teuthology.orchestra.run.smithi026.stderr: 23750K .......... .......... .......... .......... .......... 25% 146M 1s 2020-04-28T12:54:56.856 INFO:teuthology.orchestra.run.smithi026.stderr: 23800K .......... .......... .......... .......... .......... 25% 158M 1s 2020-04-28T12:54:56.856 INFO:teuthology.orchestra.run.smithi026.stderr: 23850K .......... .......... .......... .......... .......... 25% 155M 1s 2020-04-28T12:54:56.856 INFO:teuthology.orchestra.run.smithi026.stderr: 23900K .......... .......... .......... .......... .......... 25% 155M 1s 2020-04-28T12:54:56.856 INFO:teuthology.orchestra.run.smithi026.stderr: 23950K .......... .......... .......... .......... .......... 25% 85.8M 1s 2020-04-28T12:54:56.856 INFO:teuthology.orchestra.run.smithi026.stderr: 24000K .......... .......... .......... .......... .......... 25% 55.7M 1s 2020-04-28T12:54:56.856 INFO:teuthology.orchestra.run.smithi026.stderr: 24050K .......... .......... .......... .......... .......... 25% 114M 1s 2020-04-28T12:54:56.857 INFO:teuthology.orchestra.run.smithi026.stderr: 24100K .......... .......... .......... .......... .......... 25% 117M 1s 2020-04-28T12:54:56.857 INFO:teuthology.orchestra.run.smithi026.stderr: 24150K .......... .......... .......... .......... .......... 26% 49.2M 1s 2020-04-28T12:54:56.857 INFO:teuthology.orchestra.run.smithi026.stderr: 24200K .......... .......... .......... .......... .......... 26% 72.0M 1s 2020-04-28T12:54:56.857 INFO:teuthology.orchestra.run.smithi026.stderr: 24250K .......... .......... .......... .......... .......... 26% 64.8M 1s 2020-04-28T12:54:56.857 INFO:teuthology.orchestra.run.smithi026.stderr: 24300K .......... .......... .......... .......... .......... 26% 117M 1s 2020-04-28T12:54:56.857 INFO:teuthology.orchestra.run.smithi026.stderr: 24350K .......... .......... .......... .......... .......... 26% 65.8M 1s 2020-04-28T12:54:56.857 INFO:teuthology.orchestra.run.smithi026.stderr: 24400K .......... .......... .......... .......... .......... 26% 53.5M 1s 2020-04-28T12:54:56.858 INFO:teuthology.orchestra.run.smithi026.stderr: 24450K .......... .......... .......... .......... .......... 26% 55.6M 1s 2020-04-28T12:54:56.858 INFO:teuthology.orchestra.run.smithi026.stderr: 24500K .......... .......... .......... .......... .......... 26% 128M 1s 2020-04-28T12:54:56.858 INFO:teuthology.orchestra.run.smithi026.stderr: 24550K .......... .......... .......... .......... .......... 26% 41.5M 1s 2020-04-28T12:54:56.858 INFO:teuthology.orchestra.run.smithi026.stderr: 24600K .......... .......... .......... .......... .......... 26% 102M 1s 2020-04-28T12:54:56.858 INFO:teuthology.orchestra.run.smithi026.stderr: 24650K .......... .......... .......... .......... .......... 26% 142M 1s 2020-04-28T12:54:56.858 INFO:teuthology.orchestra.run.smithi026.stderr: 24700K .......... .......... .......... .......... .......... 26% 47.0M 1s 2020-04-28T12:54:56.859 INFO:teuthology.orchestra.run.smithi026.stderr: 24750K .......... .......... .......... .......... .......... 26% 115M 1s 2020-04-28T12:54:56.859 INFO:teuthology.orchestra.run.smithi026.stderr: 24800K .......... .......... .......... .......... .......... 26% 54.3M 1s 2020-04-28T12:54:56.859 INFO:teuthology.orchestra.run.smithi026.stderr: 24850K .......... .......... .......... .......... .......... 26% 95.4M 1s 2020-04-28T12:54:56.859 INFO:teuthology.orchestra.run.smithi026.stderr: 24900K .......... .......... .......... .......... .......... 26% 48.5M 1s 2020-04-28T12:54:56.859 INFO:teuthology.orchestra.run.smithi026.stderr: 24950K .......... .......... .......... .......... .......... 26% 144M 1s 2020-04-28T12:54:56.859 INFO:teuthology.orchestra.run.smithi026.stderr: 25000K .......... .......... .......... .......... .......... 26% 58.0M 1s 2020-04-28T12:54:56.859 INFO:teuthology.orchestra.run.smithi026.stderr: 25050K .......... .......... .......... .......... .......... 27% 114M 1s 2020-04-28T12:54:56.860 INFO:teuthology.orchestra.run.smithi026.stderr: 25100K .......... .......... .......... .......... .......... 27% 84.1M 1s 2020-04-28T12:54:56.860 INFO:teuthology.orchestra.run.smithi026.stderr: 25150K .......... .......... .......... .......... .......... 27% 60.7M 1s 2020-04-28T12:54:56.860 INFO:teuthology.orchestra.run.smithi026.stderr: 25200K .......... .......... .......... .......... .......... 27% 59.5M 1s 2020-04-28T12:54:56.860 INFO:teuthology.orchestra.run.smithi026.stderr: 25250K .......... .......... .......... .......... .......... 27% 156M 1s 2020-04-28T12:54:56.861 INFO:teuthology.orchestra.run.smithi026.stderr: 25300K .......... .......... .......... .......... .......... 27% 73.4M 1s 2020-04-28T12:54:56.861 INFO:teuthology.orchestra.run.smithi026.stderr: 25350K .......... .......... .......... .......... .......... 27% 110M 1s 2020-04-28T12:54:56.861 INFO:teuthology.orchestra.run.smithi026.stderr: 25400K .......... .......... .......... .......... .......... 27% 114M 1s 2020-04-28T12:54:56.861 INFO:teuthology.orchestra.run.smithi026.stderr: 25450K .......... .......... .......... .......... .......... 27% 75.8M 1s 2020-04-28T12:54:56.861 INFO:teuthology.orchestra.run.smithi026.stderr: 25500K .......... .......... .......... .......... .......... 27% 113M 1s 2020-04-28T12:54:56.861 INFO:teuthology.orchestra.run.smithi026.stderr: 25550K .......... .......... .......... .......... .......... 27% 57.5M 1s 2020-04-28T12:54:56.862 INFO:teuthology.orchestra.run.smithi026.stderr: 25600K .......... .......... .......... .......... .......... 27% 119M 1s 2020-04-28T12:54:56.862 INFO:teuthology.orchestra.run.smithi026.stderr: 25650K .......... .......... .......... .......... .......... 27% 74.2M 1s 2020-04-28T12:54:56.862 INFO:teuthology.orchestra.run.smithi026.stderr: 25700K .......... .......... .......... .......... .......... 27% 65.3M 1s 2020-04-28T12:54:56.862 INFO:teuthology.orchestra.run.smithi026.stderr: 25750K .......... .......... .......... .......... .......... 27% 106M 1s 2020-04-28T12:54:56.862 INFO:teuthology.orchestra.run.smithi026.stderr: 25800K .......... .......... .......... .......... .......... 27% 113M 1s 2020-04-28T12:54:56.863 INFO:teuthology.orchestra.run.smithi026.stderr: 25850K .......... .......... .......... .......... .......... 27% 74.3M 1s 2020-04-28T12:54:56.863 INFO:teuthology.orchestra.run.smithi026.stderr: 25900K .......... .......... .......... .......... .......... 27% 68.1M 1s 2020-04-28T12:54:56.863 INFO:teuthology.orchestra.run.smithi026.stderr: 25950K .......... .......... .......... .......... .......... 27% 64.6M 1s 2020-04-28T12:54:56.863 INFO:teuthology.orchestra.run.smithi026.stderr: 26000K .......... .......... .......... .......... .......... 28% 97.6M 1s 2020-04-28T12:54:56.863 INFO:teuthology.orchestra.run.smithi026.stderr: 26050K .......... .......... .......... .......... .......... 28% 117M 1s 2020-04-28T12:54:56.863 INFO:teuthology.orchestra.run.smithi026.stderr: 26100K .......... .......... .......... .......... .......... 28% 70.2M 1s 2020-04-28T12:54:56.863 INFO:teuthology.orchestra.run.smithi026.stderr: 26150K .......... .......... .......... .......... .......... 28% 71.2M 1s 2020-04-28T12:54:56.864 INFO:teuthology.orchestra.run.smithi026.stderr: 26200K .......... .......... .......... .......... .......... 28% 107M 1s 2020-04-28T12:54:56.864 INFO:teuthology.orchestra.run.smithi026.stderr: 26250K .......... .......... .......... .......... .......... 28% 51.3M 1s 2020-04-28T12:54:56.864 INFO:teuthology.orchestra.run.smithi026.stderr: 26300K .......... .......... .......... .......... .......... 28% 30.4M 1s 2020-04-28T12:54:56.864 INFO:teuthology.orchestra.run.smithi026.stderr: 26350K .......... .......... .......... .......... .......... 28% 68.0M 1s 2020-04-28T12:54:56.864 INFO:teuthology.orchestra.run.smithi026.stderr: 26400K .......... .......... .......... .......... .......... 28% 84.7M 1s 2020-04-28T12:54:56.864 INFO:teuthology.orchestra.run.smithi026.stderr: 26450K .......... .......... .......... .......... .......... 28% 71.2M 1s 2020-04-28T12:54:56.865 INFO:teuthology.orchestra.run.smithi026.stderr: 26500K .......... .......... .......... .......... .......... 28% 113M 1s 2020-04-28T12:54:56.865 INFO:teuthology.orchestra.run.smithi026.stderr: 26550K .......... .......... .......... .......... .......... 28% 111M 1s 2020-04-28T12:54:56.865 INFO:teuthology.orchestra.run.smithi026.stderr: 26600K .......... .......... .......... .......... .......... 28% 66.4M 1s 2020-04-28T12:54:56.865 INFO:teuthology.orchestra.run.smithi026.stderr: 26650K .......... .......... .......... .......... .......... 28% 74.5M 1s 2020-04-28T12:54:56.865 INFO:teuthology.orchestra.run.smithi026.stderr: 26700K .......... .......... .......... .......... .......... 28% 119M 1s 2020-04-28T12:54:56.865 INFO:teuthology.orchestra.run.smithi026.stderr: 26750K .......... .......... .......... .......... .......... 28% 64.9M 1s 2020-04-28T12:54:56.865 INFO:teuthology.orchestra.run.smithi026.stderr: 26800K .......... .......... .......... .......... .......... 28% 124M 1s 2020-04-28T12:54:56.866 INFO:teuthology.orchestra.run.smithi026.stderr: 26850K .......... .......... .......... .......... .......... 28% 73.4M 1s 2020-04-28T12:54:56.866 INFO:teuthology.orchestra.run.smithi026.stderr: 26900K .......... .......... .......... .......... .......... 29% 66.5M 1s 2020-04-28T12:54:56.866 INFO:teuthology.orchestra.run.smithi026.stderr: 26950K .......... .......... .......... .......... .......... 29% 108M 1s 2020-04-28T12:54:56.866 INFO:teuthology.orchestra.run.smithi026.stderr: 27000K .......... .......... .......... .......... .......... 29% 76.1M 1s 2020-04-28T12:54:56.866 INFO:teuthology.orchestra.run.smithi026.stderr: 27050K .......... .......... .......... .......... .......... 29% 117M 1s 2020-04-28T12:54:56.866 INFO:teuthology.orchestra.run.smithi026.stderr: 27100K .......... .......... .......... .......... .......... 29% 66.7M 1s 2020-04-28T12:54:56.867 INFO:teuthology.orchestra.run.smithi026.stderr: 27150K .......... .......... .......... .......... .......... 29% 70.8M 1s 2020-04-28T12:54:56.867 INFO:teuthology.orchestra.run.smithi026.stderr: 27200K .......... .......... .......... .......... .......... 29% 87.0M 1s 2020-04-28T12:54:56.867 INFO:teuthology.orchestra.run.smithi026.stderr: 27250K .......... .......... .......... .......... .......... 29% 61.5M 1s 2020-04-28T12:54:56.867 INFO:teuthology.orchestra.run.smithi026.stderr: 27300K .......... .......... .......... .......... .......... 29% 112M 1s 2020-04-28T12:54:56.867 INFO:teuthology.orchestra.run.smithi026.stderr: 27350K .......... .......... .......... .......... .......... 29% 79.3M 1s 2020-04-28T12:54:56.867 INFO:teuthology.orchestra.run.smithi026.stderr: 27400K .......... .......... .......... .......... .......... 29% 137M 1s 2020-04-28T12:54:56.867 INFO:teuthology.orchestra.run.smithi026.stderr: 27450K .......... .......... .......... .......... .......... 29% 49.4M 1s 2020-04-28T12:54:56.868 INFO:teuthology.orchestra.run.smithi026.stderr: 27500K .......... .......... .......... .......... .......... 29% 125M 1s 2020-04-28T12:54:56.868 INFO:teuthology.orchestra.run.smithi026.stderr: 27550K .......... .......... .......... .......... .......... 29% 91.2M 1s 2020-04-28T12:54:56.868 INFO:teuthology.orchestra.run.smithi026.stderr: 27600K .......... .......... .......... .......... .......... 29% 50.0M 1s 2020-04-28T12:54:56.868 INFO:teuthology.orchestra.run.smithi026.stderr: 27650K .......... .......... .......... .......... .......... 29% 114M 1s 2020-04-28T12:54:56.868 INFO:teuthology.orchestra.run.smithi026.stderr: 27700K .......... .......... .......... .......... .......... 29% 51.2M 1s 2020-04-28T12:54:56.868 INFO:teuthology.orchestra.run.smithi026.stderr: 27750K .......... .......... .......... .......... .......... 29% 112M 1s 2020-04-28T12:54:56.869 INFO:teuthology.orchestra.run.smithi026.stderr: 27800K .......... .......... .......... .......... .......... 29% 110M 1s 2020-04-28T12:54:56.869 INFO:teuthology.orchestra.run.smithi026.stderr: 27850K .......... .......... .......... .......... .......... 30% 69.3M 1s 2020-04-28T12:54:56.869 INFO:teuthology.orchestra.run.smithi026.stderr: 27900K .......... .......... .......... .......... .......... 30% 49.4M 1s 2020-04-28T12:54:56.869 INFO:teuthology.orchestra.run.smithi026.stderr: 27950K .......... .......... .......... .......... .......... 30% 63.2M 1s 2020-04-28T12:54:56.869 INFO:teuthology.orchestra.run.smithi026.stderr: 28000K .......... .......... .......... .......... .......... 30% 68.5M 1s 2020-04-28T12:54:56.869 INFO:teuthology.orchestra.run.smithi026.stderr: 28050K .......... .......... .......... .......... .......... 30% 118M 1s 2020-04-28T12:54:56.869 INFO:teuthology.orchestra.run.smithi026.stderr: 28100K .......... .......... .......... .......... .......... 30% 107M 1s 2020-04-28T12:54:56.870 INFO:teuthology.orchestra.run.smithi026.stderr: 28150K .......... .......... .......... .......... .......... 30% 70.0M 1s 2020-04-28T12:54:56.870 INFO:teuthology.orchestra.run.smithi026.stderr: 28200K .......... .......... .......... .......... .......... 30% 70.4M 1s 2020-04-28T12:54:56.870 INFO:teuthology.orchestra.run.smithi026.stderr: 28250K .......... .......... .......... .......... .......... 30% 123M 1s 2020-04-28T12:54:56.870 INFO:teuthology.orchestra.run.smithi026.stderr: 28300K .......... .......... .......... .......... .......... 30% 72.8M 1s 2020-04-28T12:54:56.871 INFO:teuthology.orchestra.run.smithi026.stderr: 28350K .......... .......... .......... .......... .......... 30% 66.5M 1s 2020-04-28T12:54:56.871 INFO:teuthology.orchestra.run.smithi026.stderr: 28400K .......... .......... .......... .......... .......... 30% 116M 1s 2020-04-28T12:54:56.871 INFO:teuthology.orchestra.run.smithi026.stderr: 28450K .......... .......... .......... .......... .......... 30% 117M 1s 2020-04-28T12:54:56.871 INFO:teuthology.orchestra.run.smithi026.stderr: 28500K .......... .......... .......... .......... .......... 30% 121M 1s 2020-04-28T12:54:56.871 INFO:teuthology.orchestra.run.smithi026.stderr: 28550K .......... .......... .......... .......... .......... 30% 103M 1s 2020-04-28T12:54:56.871 INFO:teuthology.orchestra.run.smithi026.stderr: 28600K .......... .......... .......... .......... .......... 30% 125M 1s 2020-04-28T12:54:56.872 INFO:teuthology.orchestra.run.smithi026.stderr: 28650K .......... .......... .......... .......... .......... 30% 114M 1s 2020-04-28T12:54:56.872 INFO:teuthology.orchestra.run.smithi026.stderr: 28700K .......... .......... .......... .......... .......... 30% 111M 1s 2020-04-28T12:54:56.872 INFO:teuthology.orchestra.run.smithi026.stderr: 28750K .......... .......... .......... .......... .......... 31% 85.1M 1s 2020-04-28T12:54:56.872 INFO:teuthology.orchestra.run.smithi026.stderr: 28800K .......... .......... .......... .......... .......... 31% 117M 1s 2020-04-28T12:54:56.872 INFO:teuthology.orchestra.run.smithi026.stderr: 28850K .......... .......... .......... .......... .......... 31% 94.3M 1s 2020-04-28T12:54:56.872 INFO:teuthology.orchestra.run.smithi026.stderr: 28900K .......... .......... .......... .......... .......... 31% 99.8M 1s 2020-04-28T12:54:56.873 INFO:teuthology.orchestra.run.smithi026.stderr: 28950K .......... .......... .......... .......... .......... 31% 110M 1s 2020-04-28T12:54:56.873 INFO:teuthology.orchestra.run.smithi026.stderr: 29000K .......... .......... .......... .......... .......... 31% 118M 1s 2020-04-28T12:54:56.873 INFO:teuthology.orchestra.run.smithi026.stderr: 29050K .......... .......... .......... .......... .......... 31% 110M 1s 2020-04-28T12:54:56.873 INFO:teuthology.orchestra.run.smithi026.stderr: 29100K .......... .......... .......... .......... .......... 31% 85.6M 1s 2020-04-28T12:54:56.873 INFO:teuthology.orchestra.run.smithi026.stderr: 29150K .......... .......... .......... .......... .......... 31% 89.8M 1s 2020-04-28T12:54:56.873 INFO:teuthology.orchestra.run.smithi026.stderr: 29200K .......... .......... .......... .......... .......... 31% 109M 1s 2020-04-28T12:54:56.874 INFO:teuthology.orchestra.run.smithi026.stderr: 29250K .......... .......... .......... .......... .......... 31% 115M 1s 2020-04-28T12:54:56.874 INFO:teuthology.orchestra.run.smithi026.stderr: 29300K .......... .......... .......... .......... .......... 31% 116M 1s 2020-04-28T12:54:56.874 INFO:teuthology.orchestra.run.smithi026.stderr: 29350K .......... .......... .......... .......... .......... 31% 55.3M 1s 2020-04-28T12:54:56.874 INFO:teuthology.orchestra.run.smithi026.stderr: 29400K .......... .......... .......... .......... .......... 31% 74.1M 1s 2020-04-28T12:54:56.874 INFO:teuthology.orchestra.run.smithi026.stderr: 29450K .......... .......... .......... .......... .......... 31% 115M 1s 2020-04-28T12:54:56.874 INFO:teuthology.orchestra.run.smithi026.stderr: 29500K .......... .......... .......... .......... .......... 31% 115M 1s 2020-04-28T12:54:56.874 INFO:teuthology.orchestra.run.smithi026.stderr: 29550K .......... .......... .......... .......... .......... 31% 90.5M 1s 2020-04-28T12:54:56.875 INFO:teuthology.orchestra.run.smithi026.stderr: 29600K .......... .......... .......... .......... .......... 31% 110M 1s 2020-04-28T12:54:56.875 INFO:teuthology.orchestra.run.smithi026.stderr: 29650K .......... .......... .......... .......... .......... 31% 56.7M 1s 2020-04-28T12:54:56.875 INFO:teuthology.orchestra.run.smithi026.stderr: 29700K .......... .......... .......... .......... .......... 32% 68.1M 1s 2020-04-28T12:54:56.875 INFO:teuthology.orchestra.run.smithi026.stderr: 29750K .......... .......... .......... .......... .......... 32% 114M 1s 2020-04-28T12:54:56.875 INFO:teuthology.orchestra.run.smithi026.stderr: 29800K .......... .......... .......... .......... .......... 32% 66.2M 1s 2020-04-28T12:54:56.875 INFO:teuthology.orchestra.run.smithi026.stderr: 29850K .......... .......... .......... .......... .......... 32% 65.7M 1s 2020-04-28T12:54:56.876 INFO:teuthology.orchestra.run.smithi026.stderr: 29900K .......... .......... .......... .......... .......... 32% 70.6M 1s 2020-04-28T12:54:56.876 INFO:teuthology.orchestra.run.smithi026.stderr: 29950K .......... .......... .......... .......... .......... 32% 85.8M 1s 2020-04-28T12:54:56.876 INFO:teuthology.orchestra.run.smithi026.stderr: 30000K .......... .......... .......... .......... .......... 32% 126M 1s 2020-04-28T12:54:56.876 INFO:teuthology.orchestra.run.smithi026.stderr: 30050K .......... .......... .......... .......... .......... 32% 66.8M 1s 2020-04-28T12:54:56.876 INFO:teuthology.orchestra.run.smithi026.stderr: 30100K .......... .......... .......... .......... .......... 32% 74.8M 1s 2020-04-28T12:54:56.876 INFO:teuthology.orchestra.run.smithi026.stderr: 30150K .......... .......... .......... .......... .......... 32% 66.7M 1s 2020-04-28T12:54:56.877 INFO:teuthology.orchestra.run.smithi026.stderr: 30200K .......... .......... .......... .......... .......... 32% 114M 1s 2020-04-28T12:54:56.877 INFO:teuthology.orchestra.run.smithi026.stderr: 30250K .......... .......... .......... .......... .......... 32% 73.1M 1s 2020-04-28T12:54:56.877 INFO:teuthology.orchestra.run.smithi026.stderr: 30300K .......... .......... .......... .......... .......... 32% 67.8M 1s 2020-04-28T12:54:56.877 INFO:teuthology.orchestra.run.smithi026.stderr: 30350K .......... .......... .......... .......... .......... 32% 62.8M 1s 2020-04-28T12:54:56.877 INFO:teuthology.orchestra.run.smithi026.stderr: 30400K .......... .......... .......... .......... .......... 32% 66.9M 1s 2020-04-28T12:54:56.877 INFO:teuthology.orchestra.run.smithi026.stderr: 30450K .......... .......... .......... .......... .......... 32% 73.5M 1s 2020-04-28T12:54:56.877 INFO:teuthology.orchestra.run.smithi026.stderr: 30500K .......... .......... .......... .......... .......... 32% 119M 1s 2020-04-28T12:54:56.878 INFO:teuthology.orchestra.run.smithi026.stderr: 30550K .......... .......... .......... .......... .......... 32% 62.8M 1s 2020-04-28T12:54:56.878 INFO:teuthology.orchestra.run.smithi026.stderr: 30600K .......... .......... .......... .......... .......... 32% 74.6M 1s 2020-04-28T12:54:56.878 INFO:teuthology.orchestra.run.smithi026.stderr: 30650K .......... .......... .......... .......... .......... 33% 72.4M 1s 2020-04-28T12:54:56.878 INFO:teuthology.orchestra.run.smithi026.stderr: 30700K .......... .......... .......... .......... .......... 33% 100M 1s 2020-04-28T12:54:56.878 INFO:teuthology.orchestra.run.smithi026.stderr: 30750K .......... .......... .......... .......... .......... 33% 65.2M 1s 2020-04-28T12:54:56.878 INFO:teuthology.orchestra.run.smithi026.stderr: 30800K .......... .......... .......... .......... .......... 33% 95.4M 1s 2020-04-28T12:54:56.879 INFO:teuthology.orchestra.run.smithi026.stderr: 30850K .......... .......... .......... .......... .......... 33% 72.4M 1s 2020-04-28T12:54:56.879 INFO:teuthology.orchestra.run.smithi026.stderr: 30900K .......... .......... .......... .......... .......... 33% 42.2M 1s 2020-04-28T12:54:56.879 INFO:teuthology.orchestra.run.smithi026.stderr: 30950K .......... .......... .......... .......... .......... 33% 144M 1s 2020-04-28T12:54:56.879 INFO:teuthology.orchestra.run.smithi026.stderr: 31000K .......... .......... .......... .......... .......... 33% 88.0M 1s 2020-04-28T12:54:56.879 INFO:teuthology.orchestra.run.smithi026.stderr: 31050K .......... .......... .......... .......... .......... 33% 65.9M 1s 2020-04-28T12:54:56.879 INFO:teuthology.orchestra.run.smithi026.stderr: 31100K .......... .......... .......... .......... .......... 33% 118M 1s 2020-04-28T12:54:56.880 INFO:teuthology.orchestra.run.smithi026.stderr: 31150K .......... .......... .......... .......... .......... 33% 45.1M 1s 2020-04-28T12:54:56.880 INFO:teuthology.orchestra.run.smithi026.stderr: 31200K .......... .......... .......... .......... .......... 33% 109M 1s 2020-04-28T12:54:56.880 INFO:teuthology.orchestra.run.smithi026.stderr: 31250K .......... .......... .......... .......... .......... 33% 119M 1s 2020-04-28T12:54:56.880 INFO:teuthology.orchestra.run.smithi026.stderr: 31300K .......... .......... .......... .......... .......... 33% 73.5M 1s 2020-04-28T12:54:56.880 INFO:teuthology.orchestra.run.smithi026.stderr: 31350K .......... .......... .......... .......... .......... 33% 64.3M 1s 2020-04-28T12:54:56.880 INFO:teuthology.orchestra.run.smithi026.stderr: 31400K .......... .......... .......... .......... .......... 33% 74.4M 1s 2020-04-28T12:54:56.881 INFO:teuthology.orchestra.run.smithi026.stderr: 31450K .......... .......... .......... .......... .......... 33% 110M 1s 2020-04-28T12:54:56.881 INFO:teuthology.orchestra.run.smithi026.stderr: 31500K .......... .......... .......... .......... .......... 33% 67.1M 1s 2020-04-28T12:54:56.881 INFO:teuthology.orchestra.run.smithi026.stderr: 31550K .......... .......... .......... .......... .......... 34% 90.7M 1s 2020-04-28T12:54:56.881 INFO:teuthology.orchestra.run.smithi026.stderr: 31600K .......... .......... .......... .......... .......... 34% 75.4M 1s 2020-04-28T12:54:56.881 INFO:teuthology.orchestra.run.smithi026.stderr: 31650K .......... .......... .......... .......... .......... 34% 66.4M 1s 2020-04-28T12:54:56.882 INFO:teuthology.orchestra.run.smithi026.stderr: 31700K .......... .......... .......... .......... .......... 34% 118M 1s 2020-04-28T12:54:56.882 INFO:teuthology.orchestra.run.smithi026.stderr: 31750K .......... .......... .......... .......... .......... 34% 106M 1s 2020-04-28T12:54:56.882 INFO:teuthology.orchestra.run.smithi026.stderr: 31800K .......... .......... .......... .......... .......... 34% 76.9M 1s 2020-04-28T12:54:56.882 INFO:teuthology.orchestra.run.smithi026.stderr: 31850K .......... .......... .......... .......... .......... 34% 66.9M 1s 2020-04-28T12:54:56.882 INFO:teuthology.orchestra.run.smithi026.stderr: 31900K .......... .......... .......... .......... .......... 34% 117M 1s 2020-04-28T12:54:56.882 INFO:teuthology.orchestra.run.smithi026.stderr: 31950K .......... .......... .......... .......... .......... 34% 89.3M 1s 2020-04-28T12:54:56.883 INFO:teuthology.orchestra.run.smithi026.stderr: 32000K .......... .......... .......... .......... .......... 34% 72.3M 1s 2020-04-28T12:54:56.883 INFO:teuthology.orchestra.run.smithi026.stderr: 32050K .......... .......... .......... .......... .......... 34% 67.4M 1s 2020-04-28T12:54:56.883 INFO:teuthology.orchestra.run.smithi026.stderr: 32100K .......... .......... .......... .......... .......... 34% 58.1M 1s 2020-04-28T12:54:56.883 INFO:teuthology.orchestra.run.smithi026.stderr: 32150K .......... .......... .......... .......... .......... 34% 146M 1s 2020-04-28T12:54:56.883 INFO:teuthology.orchestra.run.smithi026.stderr: 32200K .......... .......... .......... .......... .......... 34% 136M 1s 2020-04-28T12:54:56.883 INFO:teuthology.orchestra.run.smithi026.stderr: 32250K .......... .......... .......... .......... .......... 34% 67.0M 1s 2020-04-28T12:54:56.883 INFO:teuthology.orchestra.run.smithi026.stderr: 32300K .......... .......... .......... .......... .......... 34% 88.5M 1s 2020-04-28T12:54:56.884 INFO:teuthology.orchestra.run.smithi026.stderr: 32350K .......... .......... .......... .......... .......... 34% 50.7M 1s 2020-04-28T12:54:56.884 INFO:teuthology.orchestra.run.smithi026.stderr: 32400K .......... .......... .......... .......... .......... 34% 64.5M 1s 2020-04-28T12:54:56.884 INFO:teuthology.orchestra.run.smithi026.stderr: 32450K .......... .......... .......... .......... .......... 34% 108M 1s 2020-04-28T12:54:56.884 INFO:teuthology.orchestra.run.smithi026.stderr: 32500K .......... .......... .......... .......... .......... 35% 81.5M 1s 2020-04-28T12:54:56.884 INFO:teuthology.orchestra.run.smithi026.stderr: 32550K .......... .......... .......... .......... .......... 35% 108M 1s 2020-04-28T12:54:56.884 INFO:teuthology.orchestra.run.smithi026.stderr: 32600K .......... .......... .......... .......... .......... 35% 74.4M 1s 2020-04-28T12:54:56.885 INFO:teuthology.orchestra.run.smithi026.stderr: 32650K .......... .......... .......... .......... .......... 35% 119M 1s 2020-04-28T12:54:56.885 INFO:teuthology.orchestra.run.smithi026.stderr: 32700K .......... .......... .......... .......... .......... 35% 66.5M 1s 2020-04-28T12:54:56.885 INFO:teuthology.orchestra.run.smithi026.stderr: 32750K .......... .......... .......... .......... .......... 35% 62.0M 1s 2020-04-28T12:54:56.885 INFO:teuthology.orchestra.run.smithi026.stderr: 32800K .......... .......... .......... .......... .......... 35% 63.9M 1s 2020-04-28T12:54:56.885 INFO:teuthology.orchestra.run.smithi026.stderr: 32850K .......... .......... .......... .......... .......... 35% 67.2M 1s 2020-04-28T12:54:56.885 INFO:teuthology.orchestra.run.smithi026.stderr: 32900K .......... .......... .......... .......... .......... 35% 76.8M 1s 2020-04-28T12:54:56.885 INFO:teuthology.orchestra.run.smithi026.stderr: 32950K .......... .......... .......... .......... .......... 35% 110M 1s 2020-04-28T12:54:56.886 INFO:teuthology.orchestra.run.smithi026.stderr: 33000K .......... .......... .......... .......... .......... 35% 73.6M 1s 2020-04-28T12:54:56.886 INFO:teuthology.orchestra.run.smithi026.stderr: 33050K .......... .......... .......... .......... .......... 35% 65.3M 1s 2020-04-28T12:54:56.886 INFO:teuthology.orchestra.run.smithi026.stderr: 33100K .......... .......... .......... .......... .......... 35% 76.4M 1s 2020-04-28T12:54:56.886 INFO:teuthology.orchestra.run.smithi026.stderr: 33150K .......... .......... .......... .......... .......... 35% 57.9M 1s 2020-04-28T12:54:56.886 INFO:teuthology.orchestra.run.smithi026.stderr: 33200K .......... .......... .......... .......... .......... 35% 116M 1s 2020-04-28T12:54:56.886 INFO:teuthology.orchestra.run.smithi026.stderr: 33250K .......... .......... .......... .......... .......... 35% 75.3M 1s 2020-04-28T12:54:56.887 INFO:teuthology.orchestra.run.smithi026.stderr: 33300K .......... .......... .......... .......... .......... 35% 65.9M 1s 2020-04-28T12:54:56.887 INFO:teuthology.orchestra.run.smithi026.stderr: 33350K .......... .......... .......... .......... .......... 35% 71.2M 1s 2020-04-28T12:54:56.887 INFO:teuthology.orchestra.run.smithi026.stderr: 33400K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T12:54:56.887 INFO:teuthology.orchestra.run.smithi026.stderr: 33450K .......... .......... .......... .......... .......... 36% 65.7M 1s 2020-04-28T12:54:56.887 INFO:teuthology.orchestra.run.smithi026.stderr: 33500K .......... .......... .......... .......... .......... 36% 74.2M 1s 2020-04-28T12:54:56.887 INFO:teuthology.orchestra.run.smithi026.stderr: 33550K .......... .......... .......... .......... .......... 36% 58.7M 1s 2020-04-28T12:54:56.887 INFO:teuthology.orchestra.run.smithi026.stderr: 33600K .......... .......... .......... .......... .......... 36% 75.8M 1s 2020-04-28T12:54:56.888 INFO:teuthology.orchestra.run.smithi026.stderr: 33650K .......... .......... .......... .......... .......... 36% 112M 1s 2020-04-28T12:54:56.888 INFO:teuthology.orchestra.run.smithi026.stderr: 33700K .......... .......... .......... .......... .......... 36% 68.4M 1s 2020-04-28T12:54:56.888 INFO:teuthology.orchestra.run.smithi026.stderr: 33750K .......... .......... .......... .......... .......... 36% 70.2M 1s 2020-04-28T12:54:56.888 INFO:teuthology.orchestra.run.smithi026.stderr: 33800K .......... .......... .......... .......... .......... 36% 109M 1s 2020-04-28T12:54:56.888 INFO:teuthology.orchestra.run.smithi026.stderr: 33850K .......... .......... .......... .......... .......... 36% 63.5M 1s 2020-04-28T12:54:56.888 INFO:teuthology.orchestra.run.smithi026.stderr: 33900K .......... .......... .......... .......... .......... 36% 129M 1s 2020-04-28T12:54:56.889 INFO:teuthology.orchestra.run.smithi026.stderr: 33950K .......... .......... .......... .......... .......... 36% 39.9M 1s 2020-04-28T12:54:56.889 INFO:teuthology.orchestra.run.smithi026.stderr: 34000K .......... .......... .......... .......... .......... 36% 88.0M 1s 2020-04-28T12:54:56.889 INFO:teuthology.orchestra.run.smithi026.stderr: 34050K .......... .......... .......... .......... .......... 36% 64.5M 1s 2020-04-28T12:54:56.889 INFO:teuthology.orchestra.run.smithi026.stderr: 34100K .......... .......... .......... .......... .......... 36% 117M 1s 2020-04-28T12:54:56.889 INFO:teuthology.orchestra.run.smithi026.stderr: 34150K .......... .......... .......... .......... .......... 36% 108M 1s 2020-04-28T12:54:56.889 INFO:teuthology.orchestra.run.smithi026.stderr: 34200K .......... .......... .......... .......... .......... 36% 49.0M 1s 2020-04-28T12:54:56.889 INFO:teuthology.orchestra.run.smithi026.stderr: 34250K .......... .......... .......... .......... .......... 36% 112M 1s 2020-04-28T12:54:56.890 INFO:teuthology.orchestra.run.smithi026.stderr: 34300K .......... .......... .......... .......... .......... 36% 73.1M 1s 2020-04-28T12:54:56.890 INFO:teuthology.orchestra.run.smithi026.stderr: 34350K .......... .......... .......... .......... .......... 37% 57.8M 1s 2020-04-28T12:54:56.890 INFO:teuthology.orchestra.run.smithi026.stderr: 34400K .......... .......... .......... .......... .......... 37% 117M 1s 2020-04-28T12:54:56.890 INFO:teuthology.orchestra.run.smithi026.stderr: 34450K .......... .......... .......... .......... .......... 37% 47.0M 1s 2020-04-28T12:54:56.890 INFO:teuthology.orchestra.run.smithi026.stderr: 34500K .......... .......... .......... .......... .......... 37% 80.9M 1s 2020-04-28T12:54:56.890 INFO:teuthology.orchestra.run.smithi026.stderr: 34550K .......... .......... .......... .......... .......... 37% 57.5M 1s 2020-04-28T12:54:56.891 INFO:teuthology.orchestra.run.smithi026.stderr: 34600K .......... .......... .......... .......... .......... 37% 107M 1s 2020-04-28T12:54:56.891 INFO:teuthology.orchestra.run.smithi026.stderr: 34650K .......... .......... .......... .......... .......... 37% 121M 1s 2020-04-28T12:54:56.891 INFO:teuthology.orchestra.run.smithi026.stderr: 34700K .......... .......... .......... .......... .......... 37% 49.8M 1s 2020-04-28T12:54:56.892 INFO:teuthology.orchestra.run.smithi026.stderr: 34750K .......... .......... .......... .......... .......... 37% 72.6M 1s 2020-04-28T12:54:56.893 INFO:teuthology.orchestra.run.smithi026.stderr: 34800K .......... .......... .......... .......... .......... 37% 58.7M 1s 2020-04-28T12:54:56.893 INFO:teuthology.orchestra.run.smithi026.stderr: 34850K .......... .......... .......... .......... .......... 37% 77.3M 1s 2020-04-28T12:54:56.893 INFO:teuthology.orchestra.run.smithi026.stderr: 34900K .......... .......... .......... .......... .......... 37% 65.4M 1s 2020-04-28T12:54:56.893 INFO:teuthology.orchestra.run.smithi026.stderr: 34950K .......... .......... .......... .......... .......... 37% 108M 1s 2020-04-28T12:54:56.893 INFO:teuthology.orchestra.run.smithi026.stderr: 35000K .......... .......... .......... .......... .......... 37% 73.0M 1s 2020-04-28T12:54:56.894 INFO:teuthology.orchestra.run.smithi026.stderr: 35050K .......... .......... .......... .......... .......... 37% 60.8M 1s 2020-04-28T12:54:56.894 INFO:teuthology.orchestra.run.smithi026.stderr: 35100K .......... .......... .......... .......... .......... 37% 131M 1s 2020-04-28T12:54:56.894 INFO:teuthology.orchestra.run.smithi026.stderr: 35150K .......... .......... .......... .......... .......... 37% 45.3M 1s 2020-04-28T12:54:56.894 INFO:teuthology.orchestra.run.smithi026.stderr: 35200K .......... .......... .......... .......... .......... 37% 126M 1s 2020-04-28T12:54:56.894 INFO:teuthology.orchestra.run.smithi026.stderr: 35250K .......... .......... .......... .......... .......... 37% 49.5M 1s 2020-04-28T12:54:56.894 INFO:teuthology.orchestra.run.smithi026.stderr: 35300K .......... .......... .......... .......... .......... 38% 84.8M 1s 2020-04-28T12:54:56.895 INFO:teuthology.orchestra.run.smithi026.stderr: 35350K .......... .......... .......... .......... .......... 38% 116M 1s 2020-04-28T12:54:56.895 INFO:teuthology.orchestra.run.smithi026.stderr: 35400K .......... .......... .......... .......... .......... 38% 57.4M 1s 2020-04-28T12:54:56.895 INFO:teuthology.orchestra.run.smithi026.stderr: 35450K .......... .......... .......... .......... .......... 38% 48.3M 1s 2020-04-28T12:54:56.895 INFO:teuthology.orchestra.run.smithi026.stderr: 35500K .......... .......... .......... .......... .......... 38% 130M 1s 2020-04-28T12:54:56.895 INFO:teuthology.orchestra.run.smithi026.stderr: 35550K .......... .......... .......... .......... .......... 38% 43.6M 1s 2020-04-28T12:54:56.895 INFO:teuthology.orchestra.run.smithi026.stderr: 35600K .......... .......... .......... .......... .......... 38% 86.8M 1s 2020-04-28T12:54:56.895 INFO:teuthology.orchestra.run.smithi026.stderr: 35650K .......... .......... .......... .......... .......... 38% 122M 1s 2020-04-28T12:54:56.896 INFO:teuthology.orchestra.run.smithi026.stderr: 35700K .......... .......... .......... .......... .......... 38% 55.6M 1s 2020-04-28T12:54:56.896 INFO:teuthology.orchestra.run.smithi026.stderr: 35750K .......... .......... .......... .......... .......... 38% 84.4M 1s 2020-04-28T12:54:56.896 INFO:teuthology.orchestra.run.smithi026.stderr: 35800K .......... .......... .......... .......... .......... 38% 70.3M 1s 2020-04-28T12:54:56.896 INFO:teuthology.orchestra.run.smithi026.stderr: 35850K .......... .......... .......... .......... .......... 38% 127M 1s 2020-04-28T12:54:56.896 INFO:teuthology.orchestra.run.smithi026.stderr: 35900K .......... .......... .......... .......... .......... 38% 60.4M 1s 2020-04-28T12:54:56.896 INFO:teuthology.orchestra.run.smithi026.stderr: 35950K .......... .......... .......... .......... .......... 38% 64.6M 1s 2020-04-28T12:54:56.897 INFO:teuthology.orchestra.run.smithi026.stderr: 36000K .......... .......... .......... .......... .......... 38% 122M 1s 2020-04-28T12:54:56.897 INFO:teuthology.orchestra.run.smithi026.stderr: 36050K .......... .......... .......... .......... .......... 38% 74.6M 1s 2020-04-28T12:54:56.897 INFO:teuthology.orchestra.run.smithi026.stderr: 36100K .......... .......... .......... .......... .......... 38% 114M 1s 2020-04-28T12:54:56.897 INFO:teuthology.orchestra.run.smithi026.stderr: 36150K .......... .......... .......... .......... .......... 38% 65.2M 1s 2020-04-28T12:54:56.897 INFO:teuthology.orchestra.run.smithi026.stderr: 36200K .......... .......... .......... .......... .......... 39% 75.4M 1s 2020-04-28T12:54:56.897 INFO:teuthology.orchestra.run.smithi026.stderr: 36250K .......... .......... .......... .......... .......... 39% 98.6M 1s 2020-04-28T12:54:56.897 INFO:teuthology.orchestra.run.smithi026.stderr: 36300K .......... .......... .......... .......... .......... 39% 71.0M 1s 2020-04-28T12:54:56.898 INFO:teuthology.orchestra.run.smithi026.stderr: 36350K .......... .......... .......... .......... .......... 39% 62.6M 1s 2020-04-28T12:54:56.898 INFO:teuthology.orchestra.run.smithi026.stderr: 36400K .......... .......... .......... .......... .......... 39% 108M 1s 2020-04-28T12:54:56.898 INFO:teuthology.orchestra.run.smithi026.stderr: 36450K .......... .......... .......... .......... .......... 39% 102M 1s 2020-04-28T12:54:56.898 INFO:teuthology.orchestra.run.smithi026.stderr: 36500K .......... .......... .......... .......... .......... 39% 55.9M 1s 2020-04-28T12:54:56.898 INFO:teuthology.orchestra.run.smithi026.stderr: 36550K .......... .......... .......... .......... .......... 39% 111M 1s 2020-04-28T12:54:56.898 INFO:teuthology.orchestra.run.smithi026.stderr: 36600K .......... .......... .......... .......... .......... 39% 120M 1s 2020-04-28T12:54:56.899 INFO:teuthology.orchestra.run.smithi026.stderr: 36650K .......... .......... .......... .......... .......... 39% 65.4M 1s 2020-04-28T12:54:56.899 INFO:teuthology.orchestra.run.smithi026.stderr: 36700K .......... .......... .......... .......... .......... 39% 67.3M 1s 2020-04-28T12:54:56.899 INFO:teuthology.orchestra.run.smithi026.stderr: 36750K .......... .......... .......... .......... .......... 39% 98.9M 1s 2020-04-28T12:54:56.899 INFO:teuthology.orchestra.run.smithi026.stderr: 36800K .......... .......... .......... .......... .......... 39% 68.9M 1s 2020-04-28T12:54:56.899 INFO:teuthology.orchestra.run.smithi026.stderr: 36850K .......... .......... .......... .......... .......... 39% 119M 1s 2020-04-28T12:54:56.899 INFO:teuthology.orchestra.run.smithi026.stderr: 36900K .......... .......... .......... .......... .......... 39% 73.3M 1s 2020-04-28T12:54:56.900 INFO:teuthology.orchestra.run.smithi026.stderr: 36950K .......... .......... .......... .......... .......... 39% 61.3M 1s 2020-04-28T12:54:56.900 INFO:teuthology.orchestra.run.smithi026.stderr: 37000K .......... .......... .......... .......... .......... 39% 111M 1s 2020-04-28T12:54:56.900 INFO:teuthology.orchestra.run.smithi026.stderr: 37050K .......... .......... .......... .......... .......... 39% 122M 1s 2020-04-28T12:54:56.900 INFO:teuthology.orchestra.run.smithi026.stderr: 37100K .......... .......... .......... .......... .......... 39% 78.0M 1s 2020-04-28T12:54:56.900 INFO:teuthology.orchestra.run.smithi026.stderr: 37150K .......... .......... .......... .......... .......... 40% 52.3M 1s 2020-04-28T12:54:56.900 INFO:teuthology.orchestra.run.smithi026.stderr: 37200K .......... .......... .......... .......... .......... 40% 72.6M 1s 2020-04-28T12:54:56.900 INFO:teuthology.orchestra.run.smithi026.stderr: 37250K .......... .......... .......... .......... .......... 40% 68.8M 1s 2020-04-28T12:54:56.901 INFO:teuthology.orchestra.run.smithi026.stderr: 37300K .......... .......... .......... .......... .......... 40% 100M 1s 2020-04-28T12:54:56.901 INFO:teuthology.orchestra.run.smithi026.stderr: 37350K .......... .......... .......... .......... .......... 40% 125M 1s 2020-04-28T12:54:56.901 INFO:teuthology.orchestra.run.smithi026.stderr: 37400K .......... .......... .......... .......... .......... 40% 51.2M 1s 2020-04-28T12:54:56.901 INFO:teuthology.orchestra.run.smithi026.stderr: 37450K .......... .......... .......... .......... .......... 40% 70.8M 1s 2020-04-28T12:54:56.902 INFO:teuthology.orchestra.run.smithi026.stderr: 37500K .......... .......... .......... .......... .......... 40% 63.3M 1s 2020-04-28T12:54:56.902 INFO:teuthology.orchestra.run.smithi026.stderr: 37550K .......... .......... .......... .......... .......... 40% 47.5M 1s 2020-04-28T12:54:56.902 INFO:teuthology.orchestra.run.smithi026.stderr: 37600K .......... .......... .......... .......... .......... 40% 194M 1s 2020-04-28T12:54:56.902 INFO:teuthology.orchestra.run.smithi026.stderr: 37650K .......... .......... .......... .......... .......... 40% 77.0M 1s 2020-04-28T12:54:56.902 INFO:teuthology.orchestra.run.smithi026.stderr: 37700K .......... .......... .......... .......... .......... 40% 74.6M 1s 2020-04-28T12:54:56.902 INFO:teuthology.orchestra.run.smithi026.stderr: 37750K .......... .......... .......... .......... .......... 40% 65.9M 1s 2020-04-28T12:54:56.903 INFO:teuthology.orchestra.run.smithi026.stderr: 37800K .......... .......... .......... .......... .......... 40% 122M 1s 2020-04-28T12:54:56.903 INFO:teuthology.orchestra.run.smithi026.stderr: 37850K .......... .......... .......... .......... .......... 40% 72.4M 1s 2020-04-28T12:54:56.903 INFO:teuthology.orchestra.run.smithi026.stderr: 37900K .......... .......... .......... .......... .......... 40% 65.4M 1s 2020-04-28T12:54:56.903 INFO:teuthology.orchestra.run.smithi026.stderr: 37950K .......... .......... .......... .......... .......... 40% 62.7M 1s 2020-04-28T12:54:56.903 INFO:teuthology.orchestra.run.smithi026.stderr: 38000K .......... .......... .......... .......... .......... 40% 65.8M 1s 2020-04-28T12:54:56.903 INFO:teuthology.orchestra.run.smithi026.stderr: 38050K .......... .......... .......... .......... .......... 41% 65.7M 1s 2020-04-28T12:54:56.904 INFO:teuthology.orchestra.run.smithi026.stderr: 38100K .......... .......... .......... .......... .......... 41% 157M 1s 2020-04-28T12:54:56.904 INFO:teuthology.orchestra.run.smithi026.stderr: 38150K .......... .......... .......... .......... .......... 41% 64.6M 1s 2020-04-28T12:54:56.904 INFO:teuthology.orchestra.run.smithi026.stderr: 38200K .......... .......... .......... .......... .......... 41% 72.8M 1s 2020-04-28T12:54:56.904 INFO:teuthology.orchestra.run.smithi026.stderr: 38250K .......... .......... .......... .......... .......... 41% 68.3M 1s 2020-04-28T12:54:56.904 INFO:teuthology.orchestra.run.smithi026.stderr: 38300K .......... .......... .......... .......... .......... 41% 117M 1s 2020-04-28T12:54:56.904 INFO:teuthology.orchestra.run.smithi026.stderr: 38350K .......... .......... .......... .......... .......... 41% 63.0M 1s 2020-04-28T12:54:56.904 INFO:teuthology.orchestra.run.smithi026.stderr: 38400K .......... .......... .......... .......... .......... 41% 66.0M 1s 2020-04-28T12:54:56.905 INFO:teuthology.orchestra.run.smithi026.stderr: 38450K .......... .......... .......... .......... .......... 41% 74.5M 1s 2020-04-28T12:54:56.905 INFO:teuthology.orchestra.run.smithi026.stderr: 38500K .......... .......... .......... .......... .......... 41% 64.5M 1s 2020-04-28T12:54:56.905 INFO:teuthology.orchestra.run.smithi026.stderr: 38550K .......... .......... .......... .......... .......... 41% 113M 1s 2020-04-28T12:54:56.905 INFO:teuthology.orchestra.run.smithi026.stderr: 38600K .......... .......... .......... .......... .......... 41% 51.1M 1s 2020-04-28T12:54:56.905 INFO:teuthology.orchestra.run.smithi026.stderr: 38650K .......... .......... .......... .......... .......... 41% 102M 1s 2020-04-28T12:54:56.905 INFO:teuthology.orchestra.run.smithi026.stderr: 38700K .......... .......... .......... .......... .......... 41% 75.2M 1s 2020-04-28T12:54:56.906 INFO:teuthology.orchestra.run.smithi026.stderr: 38750K .......... .......... .......... .......... .......... 41% 55.9M 1s 2020-04-28T12:54:56.906 INFO:teuthology.orchestra.run.smithi026.stderr: 38800K .......... .......... .......... .......... .......... 41% 121M 1s 2020-04-28T12:54:56.906 INFO:teuthology.orchestra.run.smithi026.stderr: 38850K .......... .......... .......... .......... .......... 41% 74.9M 1s 2020-04-28T12:54:56.906 INFO:teuthology.orchestra.run.smithi026.stderr: 38900K .......... .......... .......... .......... .......... 41% 49.6M 1s 2020-04-28T12:54:56.906 INFO:teuthology.orchestra.run.smithi026.stderr: 38950K .......... .......... .......... .......... .......... 41% 113M 1s 2020-04-28T12:54:56.907 INFO:teuthology.orchestra.run.smithi026.stderr: 39000K .......... .......... .......... .......... .......... 42% 59.7M 1s 2020-04-28T12:54:56.907 INFO:teuthology.orchestra.run.smithi026.stderr: 39050K .......... .......... .......... .......... .......... 42% 138M 1s 2020-04-28T12:54:56.907 INFO:teuthology.orchestra.run.smithi026.stderr: 39100K .......... .......... .......... .......... .......... 42% 75.3M 1s 2020-04-28T12:54:56.907 INFO:teuthology.orchestra.run.smithi026.stderr: 39150K .......... .......... .......... .......... .......... 42% 56.4M 1s 2020-04-28T12:54:56.907 INFO:teuthology.orchestra.run.smithi026.stderr: 39200K .......... .......... .......... .......... .......... 42% 77.4M 1s 2020-04-28T12:54:56.907 INFO:teuthology.orchestra.run.smithi026.stderr: 39250K .......... .......... .......... .......... .......... 42% 62.8M 1s 2020-04-28T12:54:56.908 INFO:teuthology.orchestra.run.smithi026.stderr: 39300K .......... .......... .......... .......... .......... 42% 113M 1s 2020-04-28T12:54:56.908 INFO:teuthology.orchestra.run.smithi026.stderr: 39350K .......... .......... .......... .......... .......... 42% 76.9M 1s 2020-04-28T12:54:56.908 INFO:teuthology.orchestra.run.smithi026.stderr: 39400K .......... .......... .......... .......... .......... 42% 62.9M 1s 2020-04-28T12:54:56.908 INFO:teuthology.orchestra.run.smithi026.stderr: 39450K .......... .......... .......... .......... .......... 42% 80.2M 1s 2020-04-28T12:54:56.908 INFO:teuthology.orchestra.run.smithi026.stderr: 39500K .......... .......... .......... .......... .......... 42% 108M 1s 2020-04-28T12:54:56.908 INFO:teuthology.orchestra.run.smithi026.stderr: 39550K .......... .......... .......... .......... .......... 42% 56.8M 1s 2020-04-28T12:54:56.909 INFO:teuthology.orchestra.run.smithi026.stderr: 39600K .......... .......... .......... .......... .......... 42% 80.8M 1s 2020-04-28T12:54:56.909 INFO:teuthology.orchestra.run.smithi026.stderr: 39650K .......... .......... .......... .......... .......... 42% 62.5M 1s 2020-04-28T12:54:56.909 INFO:teuthology.orchestra.run.smithi026.stderr: 39700K .......... .......... .......... .......... .......... 42% 72.8M 1s 2020-04-28T12:54:56.909 INFO:teuthology.orchestra.run.smithi026.stderr: 39750K .......... .......... .......... .......... .......... 42% 115M 1s 2020-04-28T12:54:56.909 INFO:teuthology.orchestra.run.smithi026.stderr: 39800K .......... .......... .......... .......... .......... 42% 119M 1s 2020-04-28T12:54:56.909 INFO:teuthology.orchestra.run.smithi026.stderr: 39850K .......... .......... .......... .......... .......... 42% 62.6M 1s 2020-04-28T12:54:56.909 INFO:teuthology.orchestra.run.smithi026.stderr: 39900K .......... .......... .......... .......... .......... 43% 79.6M 1s 2020-04-28T12:54:56.910 INFO:teuthology.orchestra.run.smithi026.stderr: 39950K .......... .......... .......... .......... .......... 43% 57.0M 1s 2020-04-28T12:54:56.910 INFO:teuthology.orchestra.run.smithi026.stderr: 40000K .......... .......... .......... .......... .......... 43% 75.6M 1s 2020-04-28T12:54:56.910 INFO:teuthology.orchestra.run.smithi026.stderr: 40050K .......... .......... .......... .......... .......... 43% 119M 1s 2020-04-28T12:54:56.910 INFO:teuthology.orchestra.run.smithi026.stderr: 40100K .......... .......... .......... .......... .......... 43% 63.6M 1s 2020-04-28T12:54:56.910 INFO:teuthology.orchestra.run.smithi026.stderr: 40150K .......... .......... .......... .......... .......... 43% 76.7M 1s 2020-04-28T12:54:56.910 INFO:teuthology.orchestra.run.smithi026.stderr: 40200K .......... .......... .......... .......... .......... 43% 63.4M 1s 2020-04-28T12:54:56.911 INFO:teuthology.orchestra.run.smithi026.stderr: 40250K .......... .......... .......... .......... .......... 43% 124M 1s 2020-04-28T12:54:56.911 INFO:teuthology.orchestra.run.smithi026.stderr: 40300K .......... .......... .......... .......... .......... 43% 60.4M 1s 2020-04-28T12:54:56.911 INFO:teuthology.orchestra.run.smithi026.stderr: 40350K .......... .......... .......... .......... .......... 43% 62.8M 1s 2020-04-28T12:54:56.911 INFO:teuthology.orchestra.run.smithi026.stderr: 40400K .......... .......... .......... .......... .......... 43% 80.3M 1s 2020-04-28T12:54:56.911 INFO:teuthology.orchestra.run.smithi026.stderr: 40450K .......... .......... .......... .......... .......... 43% 64.4M 1s 2020-04-28T12:54:56.911 INFO:teuthology.orchestra.run.smithi026.stderr: 40500K .......... .......... .......... .......... .......... 43% 49.8M 1s 2020-04-28T12:54:56.912 INFO:teuthology.orchestra.run.smithi026.stderr: 40550K .......... .......... .......... .......... .......... 43% 114M 1s 2020-04-28T12:54:56.912 INFO:teuthology.orchestra.run.smithi026.stderr: 40600K .......... .......... .......... .......... .......... 43% 68.4M 1s 2020-04-28T12:54:56.912 INFO:teuthology.orchestra.run.smithi026.stderr: 40650K .......... .......... .......... .......... .......... 43% 62.0M 1s 2020-04-28T12:54:56.912 INFO:teuthology.orchestra.run.smithi026.stderr: 40700K .......... .......... .......... .......... .......... 43% 115M 1s 2020-04-28T12:54:56.913 INFO:teuthology.orchestra.run.smithi026.stderr: 40750K .......... .......... .......... .......... .......... 43% 43.7M 1s 2020-04-28T12:54:56.913 INFO:teuthology.orchestra.run.smithi026.stderr: 40800K .......... .......... .......... .......... .......... 43% 124M 1s 2020-04-28T12:54:56.913 INFO:teuthology.orchestra.run.smithi026.stderr: 40850K .......... .......... .......... .......... .......... 44% 77.2M 1s 2020-04-28T12:54:56.913 INFO:teuthology.orchestra.run.smithi026.stderr: 40900K .......... .......... .......... .......... .......... 44% 63.3M 1s 2020-04-28T12:54:56.913 INFO:teuthology.orchestra.run.smithi026.stderr: 40950K .......... .......... .......... .......... .......... 44% 73.9M 1s 2020-04-28T12:54:56.913 INFO:teuthology.orchestra.run.smithi026.stderr: 41000K .......... .......... .......... .......... .......... 44% 120M 1s 2020-04-28T12:54:56.913 INFO:teuthology.orchestra.run.smithi026.stderr: 41050K .......... .......... .......... .......... .......... 44% 63.4M 1s 2020-04-28T12:54:56.914 INFO:teuthology.orchestra.run.smithi026.stderr: 41100K .......... .......... .......... .......... .......... 44% 77.9M 1s 2020-04-28T12:54:56.914 INFO:teuthology.orchestra.run.smithi026.stderr: 41150K .......... .......... .......... .......... .......... 44% 87.9M 1s 2020-04-28T12:54:56.914 INFO:teuthology.orchestra.run.smithi026.stderr: 41200K .......... .......... .......... .......... .......... 44% 120M 1s 2020-04-28T12:54:56.914 INFO:teuthology.orchestra.run.smithi026.stderr: 41250K .......... .......... .......... .......... .......... 44% 123M 1s 2020-04-28T12:54:56.914 INFO:teuthology.orchestra.run.smithi026.stderr: 41300K .......... .......... .......... .......... .......... 44% 114M 1s 2020-04-28T12:54:56.914 INFO:teuthology.orchestra.run.smithi026.stderr: 41350K .......... .......... .......... .......... .......... 44% 108M 1s 2020-04-28T12:54:56.915 INFO:teuthology.orchestra.run.smithi026.stderr: 41400K .......... .......... .......... .......... .......... 44% 116M 1s 2020-04-28T12:54:56.915 INFO:teuthology.orchestra.run.smithi026.stderr: 41450K .......... .......... .......... .......... .......... 44% 119M 1s 2020-04-28T12:54:56.915 INFO:teuthology.orchestra.run.smithi026.stderr: 41500K .......... .......... .......... .......... .......... 44% 114M 1s 2020-04-28T12:54:56.915 INFO:teuthology.orchestra.run.smithi026.stderr: 41550K .......... .......... .......... .......... .......... 44% 83.3M 1s 2020-04-28T12:54:56.915 INFO:teuthology.orchestra.run.smithi026.stderr: 41600K .......... .......... .......... .......... .......... 44% 125M 1s 2020-04-28T12:54:56.915 INFO:teuthology.orchestra.run.smithi026.stderr: 41650K .......... .......... .......... .......... .......... 44% 116M 1s 2020-04-28T12:54:56.916 INFO:teuthology.orchestra.run.smithi026.stderr: 41700K .......... .......... .......... .......... .......... 44% 114M 1s 2020-04-28T12:54:56.916 INFO:teuthology.orchestra.run.smithi026.stderr: 41750K .......... .......... .......... .......... .......... 44% 105M 1s 2020-04-28T12:54:56.916 INFO:teuthology.orchestra.run.smithi026.stderr: 41800K .......... .......... .......... .......... .......... 45% 112M 1s 2020-04-28T12:54:56.916 INFO:teuthology.orchestra.run.smithi026.stderr: 41850K .......... .......... .......... .......... .......... 45% 123M 1s 2020-04-28T12:54:56.916 INFO:teuthology.orchestra.run.smithi026.stderr: 41900K .......... .......... .......... .......... .......... 45% 50.6M 1s 2020-04-28T12:54:56.916 INFO:teuthology.orchestra.run.smithi026.stderr: 41950K .......... .......... .......... .......... .......... 45% 59.8M 1s 2020-04-28T12:54:56.917 INFO:teuthology.orchestra.run.smithi026.stderr: 42000K .......... .......... .......... .......... .......... 45% 104M 1s 2020-04-28T12:54:56.917 INFO:teuthology.orchestra.run.smithi026.stderr: 42050K .......... .......... .......... .......... .......... 45% 77.7M 1s 2020-04-28T12:54:56.917 INFO:teuthology.orchestra.run.smithi026.stderr: 42100K .......... .......... .......... .......... .......... 45% 64.7M 1s 2020-04-28T12:54:56.917 INFO:teuthology.orchestra.run.smithi026.stderr: 42150K .......... .......... .......... .......... .......... 45% 98.5M 1s 2020-04-28T12:54:56.917 INFO:teuthology.orchestra.run.smithi026.stderr: 42200K .......... .......... .......... .......... .......... 45% 54.2M 1s 2020-04-28T12:54:56.917 INFO:teuthology.orchestra.run.smithi026.stderr: 42250K .......... .......... .......... .......... .......... 45% 117M 1s 2020-04-28T12:54:56.918 INFO:teuthology.orchestra.run.smithi026.stderr: 42300K .......... .......... .......... .......... .......... 45% 72.8M 1s 2020-04-28T12:54:56.918 INFO:teuthology.orchestra.run.smithi026.stderr: 42350K .......... .......... .......... .......... .......... 45% 56.6M 1s 2020-04-28T12:54:56.918 INFO:teuthology.orchestra.run.smithi026.stderr: 42400K .......... .......... .......... .......... .......... 45% 78.3M 1s 2020-04-28T12:54:56.918 INFO:teuthology.orchestra.run.smithi026.stderr: 42450K .......... .......... .......... .......... .......... 45% 63.6M 1s 2020-04-28T12:54:56.918 INFO:teuthology.orchestra.run.smithi026.stderr: 42500K .......... .......... .......... .......... .......... 45% 122M 1s 2020-04-28T12:54:56.918 INFO:teuthology.orchestra.run.smithi026.stderr: 42550K .......... .......... .......... .......... .......... 45% 73.0M 1s 2020-04-28T12:54:56.919 INFO:teuthology.orchestra.run.smithi026.stderr: 42600K .......... .......... .......... .......... .......... 45% 65.0M 1s 2020-04-28T12:54:56.919 INFO:teuthology.orchestra.run.smithi026.stderr: 42650K .......... .......... .......... .......... .......... 45% 78.7M 1s 2020-04-28T12:54:56.919 INFO:teuthology.orchestra.run.smithi026.stderr: 42700K .......... .......... .......... .......... .......... 46% 114M 1s 2020-04-28T12:54:56.919 INFO:teuthology.orchestra.run.smithi026.stderr: 42750K .......... .......... .......... .......... .......... 46% 54.1M 1s 2020-04-28T12:54:56.919 INFO:teuthology.orchestra.run.smithi026.stderr: 42800K .......... .......... .......... .......... .......... 46% 127M 1s 2020-04-28T12:54:56.919 INFO:teuthology.orchestra.run.smithi026.stderr: 42850K .......... .......... .......... .......... .......... 46% 50.6M 1s 2020-04-28T12:54:56.919 INFO:teuthology.orchestra.run.smithi026.stderr: 42900K .......... .......... .......... .......... .......... 46% 116M 1s 2020-04-28T12:54:56.920 INFO:teuthology.orchestra.run.smithi026.stderr: 42950K .......... .......... .......... .......... .......... 46% 86.8M 1s 2020-04-28T12:54:56.920 INFO:teuthology.orchestra.run.smithi026.stderr: 43000K .......... .......... .......... .......... .......... 46% 56.7M 1s 2020-04-28T12:54:56.920 INFO:teuthology.orchestra.run.smithi026.stderr: 43050K .......... .......... .......... .......... .......... 46% 75.1M 1s 2020-04-28T12:54:56.920 INFO:teuthology.orchestra.run.smithi026.stderr: 43100K .......... .......... .......... .......... .......... 46% 66.9M 1s 2020-04-28T12:54:56.920 INFO:teuthology.orchestra.run.smithi026.stderr: 43150K .......... .......... .......... .......... .......... 46% 63.8M 1s 2020-04-28T12:54:56.920 INFO:teuthology.orchestra.run.smithi026.stderr: 43200K .......... .......... .......... .......... .......... 46% 65.7M 1s 2020-04-28T12:54:56.921 INFO:teuthology.orchestra.run.smithi026.stderr: 43250K .......... .......... .......... .......... .......... 46% 112M 1s 2020-04-28T12:54:56.921 INFO:teuthology.orchestra.run.smithi026.stderr: 43300K .......... .......... .......... .......... .......... 46% 75.4M 1s 2020-04-28T12:54:56.921 INFO:teuthology.orchestra.run.smithi026.stderr: 43350K .......... .......... .......... .......... .......... 46% 65.5M 1s 2020-04-28T12:54:56.921 INFO:teuthology.orchestra.run.smithi026.stderr: 43400K .......... .......... .......... .......... .......... 46% 74.6M 1s 2020-04-28T12:54:56.921 INFO:teuthology.orchestra.run.smithi026.stderr: 43450K .......... .......... .......... .......... .......... 46% 106M 1s 2020-04-28T12:54:56.921 INFO:teuthology.orchestra.run.smithi026.stderr: 43500K .......... .......... .......... .......... .......... 46% 70.9M 1s 2020-04-28T12:54:56.921 INFO:teuthology.orchestra.run.smithi026.stderr: 43550K .......... .......... .......... .......... .......... 46% 44.9M 1s 2020-04-28T12:54:56.922 INFO:teuthology.orchestra.run.smithi026.stderr: 43600K .......... .......... .......... .......... .......... 46% 75.9M 1s 2020-04-28T12:54:56.922 INFO:teuthology.orchestra.run.smithi026.stderr: 43650K .......... .......... .......... .......... .......... 47% 66.3M 1s 2020-04-28T12:54:56.922 INFO:teuthology.orchestra.run.smithi026.stderr: 43700K .......... .......... .......... .......... .......... 47% 95.6M 1s 2020-04-28T12:54:56.922 INFO:teuthology.orchestra.run.smithi026.stderr: 43750K .......... .......... .......... .......... .......... 47% 112M 1s 2020-04-28T12:54:56.923 INFO:teuthology.orchestra.run.smithi026.stderr: 43800K .......... .......... .......... .......... .......... 47% 51.6M 1s 2020-04-28T12:54:56.923 INFO:teuthology.orchestra.run.smithi026.stderr: 43850K .......... .......... .......... .......... .......... 47% 82.4M 1s 2020-04-28T12:54:56.923 INFO:teuthology.orchestra.run.smithi026.stderr: 43900K .......... .......... .......... .......... .......... 47% 63.7M 1s 2020-04-28T12:54:56.923 INFO:teuthology.orchestra.run.smithi026.stderr: 43950K .......... .......... .......... .......... .......... 47% 67.5M 1s 2020-04-28T12:54:56.923 INFO:teuthology.orchestra.run.smithi026.stderr: 44000K .......... .......... .......... .......... .......... 47% 113M 1s 2020-04-28T12:54:56.923 INFO:teuthology.orchestra.run.smithi026.stderr: 44050K .......... .......... .......... .......... .......... 47% 64.8M 1s 2020-04-28T12:54:56.924 INFO:teuthology.orchestra.run.smithi026.stderr: 44100K .......... .......... .......... .......... .......... 47% 76.2M 1s 2020-04-28T12:54:56.924 INFO:teuthology.orchestra.run.smithi026.stderr: 44150K .......... .......... .......... .......... .......... 47% 65.0M 1s 2020-04-28T12:54:56.924 INFO:teuthology.orchestra.run.smithi026.stderr: 44200K .......... .......... .......... .......... .......... 47% 105M 1s 2020-04-28T12:54:56.924 INFO:teuthology.orchestra.run.smithi026.stderr: 44250K .......... .......... .......... .......... .......... 47% 114M 1s 2020-04-28T12:54:56.924 INFO:teuthology.orchestra.run.smithi026.stderr: 44300K .......... .......... .......... .......... .......... 47% 79.5M 1s 2020-04-28T12:54:56.924 INFO:teuthology.orchestra.run.smithi026.stderr: 44350K .......... .......... .......... .......... .......... 47% 58.0M 1s 2020-04-28T12:54:56.924 INFO:teuthology.orchestra.run.smithi026.stderr: 44400K .......... .......... .......... .......... .......... 47% 76.8M 1s 2020-04-28T12:54:56.925 INFO:teuthology.orchestra.run.smithi026.stderr: 44450K .......... .......... .......... .......... .......... 47% 116M 1s 2020-04-28T12:54:56.925 INFO:teuthology.orchestra.run.smithi026.stderr: 44500K .......... .......... .......... .......... .......... 47% 62.7M 1s 2020-04-28T12:54:56.925 INFO:teuthology.orchestra.run.smithi026.stderr: 44550K .......... .......... .......... .......... .......... 48% 77.6M 1s 2020-04-28T12:54:56.925 INFO:teuthology.orchestra.run.smithi026.stderr: 44600K .......... .......... .......... .......... .......... 48% 60.6M 1s 2020-04-28T12:54:56.925 INFO:teuthology.orchestra.run.smithi026.stderr: 44650K .......... .......... .......... .......... .......... 48% 104M 1s 2020-04-28T12:54:56.925 INFO:teuthology.orchestra.run.smithi026.stderr: 44700K .......... .......... .......... .......... .......... 48% 130M 1s 2020-04-28T12:54:56.926 INFO:teuthology.orchestra.run.smithi026.stderr: 44750K .......... .......... .......... .......... .......... 48% 64.9M 1s 2020-04-28T12:54:56.926 INFO:teuthology.orchestra.run.smithi026.stderr: 44800K .......... .......... .......... .......... .......... 48% 55.3M 1s 2020-04-28T12:54:56.926 INFO:teuthology.orchestra.run.smithi026.stderr: 44850K .......... .......... .......... .......... .......... 48% 102M 1s 2020-04-28T12:54:56.926 INFO:teuthology.orchestra.run.smithi026.stderr: 44900K .......... .......... .......... .......... .......... 48% 66.8M 1s 2020-04-28T12:54:56.926 INFO:teuthology.orchestra.run.smithi026.stderr: 44950K .......... .......... .......... .......... .......... 48% 108M 1s 2020-04-28T12:54:56.926 INFO:teuthology.orchestra.run.smithi026.stderr: 45000K .......... .......... .......... .......... .......... 48% 76.0M 1s 2020-04-28T12:54:56.926 INFO:teuthology.orchestra.run.smithi026.stderr: 45050K .......... .......... .......... .......... .......... 48% 67.4M 1s 2020-04-28T12:54:56.927 INFO:teuthology.orchestra.run.smithi026.stderr: 45100K .......... .......... .......... .......... .......... 48% 109M 1s 2020-04-28T12:54:56.927 INFO:teuthology.orchestra.run.smithi026.stderr: 45150K .......... .......... .......... .......... .......... 48% 66.5M 1s 2020-04-28T12:54:56.927 INFO:teuthology.orchestra.run.smithi026.stderr: 45200K .......... .......... .......... .......... .......... 48% 111M 1s 2020-04-28T12:54:56.927 INFO:teuthology.orchestra.run.smithi026.stderr: 45250K .......... .......... .......... .......... .......... 48% 66.7M 1s 2020-04-28T12:54:56.927 INFO:teuthology.orchestra.run.smithi026.stderr: 45300K .......... .......... .......... .......... .......... 48% 77.0M 1s 2020-04-28T12:54:56.927 INFO:teuthology.orchestra.run.smithi026.stderr: 45350K .......... .......... .......... .......... .......... 48% 63.1M 1s 2020-04-28T12:54:56.928 INFO:teuthology.orchestra.run.smithi026.stderr: 45400K .......... .......... .......... .......... .......... 48% 118M 1s 2020-04-28T12:54:56.928 INFO:teuthology.orchestra.run.smithi026.stderr: 45450K .......... .......... .......... .......... .......... 48% 76.6M 1s 2020-04-28T12:54:56.928 INFO:teuthology.orchestra.run.smithi026.stderr: 45500K .......... .......... .......... .......... .......... 49% 63.8M 1s 2020-04-28T12:54:56.928 INFO:teuthology.orchestra.run.smithi026.stderr: 45550K .......... .......... .......... .......... .......... 49% 64.5M 1s 2020-04-28T12:54:56.928 INFO:teuthology.orchestra.run.smithi026.stderr: 45600K .......... .......... .......... .......... .......... 49% 110M 1s 2020-04-28T12:54:56.928 INFO:teuthology.orchestra.run.smithi026.stderr: 45650K .......... .......... .......... .......... .......... 49% 112M 1s 2020-04-28T12:54:56.929 INFO:teuthology.orchestra.run.smithi026.stderr: 45700K .......... .......... .......... .......... .......... 49% 115M 1s 2020-04-28T12:54:56.929 INFO:teuthology.orchestra.run.smithi026.stderr: 45750K .......... .......... .......... .......... .......... 49% 118M 1s 2020-04-28T12:54:56.929 INFO:teuthology.orchestra.run.smithi026.stderr: 45800K .......... .......... .......... .......... .......... 49% 115M 1s 2020-04-28T12:54:56.929 INFO:teuthology.orchestra.run.smithi026.stderr: 45850K .......... .......... .......... .......... .......... 49% 119M 1s 2020-04-28T12:54:56.929 INFO:teuthology.orchestra.run.smithi026.stderr: 45900K .......... .......... .......... .......... .......... 49% 111M 1s 2020-04-28T12:54:56.929 INFO:teuthology.orchestra.run.smithi026.stderr: 45950K .......... .......... .......... .......... .......... 49% 88.2M 1s 2020-04-28T12:54:56.929 INFO:teuthology.orchestra.run.smithi026.stderr: 46000K .......... .......... .......... .......... .......... 49% 112M 1s 2020-04-28T12:54:56.930 INFO:teuthology.orchestra.run.smithi026.stderr: 46050K .......... .......... .......... .......... .......... 49% 119M 1s 2020-04-28T12:54:56.930 INFO:teuthology.orchestra.run.smithi026.stderr: 46100K .......... .......... .......... .......... .......... 49% 115M 1s 2020-04-28T12:54:56.930 INFO:teuthology.orchestra.run.smithi026.stderr: 46150K .......... .......... .......... .......... .......... 49% 111M 1s 2020-04-28T12:54:56.930 INFO:teuthology.orchestra.run.smithi026.stderr: 46200K .......... .......... .......... .......... .......... 49% 112M 1s 2020-04-28T12:54:56.930 INFO:teuthology.orchestra.run.smithi026.stderr: 46250K .......... .......... .......... .......... .......... 49% 114M 1s 2020-04-28T12:54:56.930 INFO:teuthology.orchestra.run.smithi026.stderr: 46300K .......... .......... .......... .......... .......... 49% 119M 1s 2020-04-28T12:54:56.931 INFO:teuthology.orchestra.run.smithi026.stderr: 46350K .......... .......... .......... .......... .......... 49% 89.9M 1s 2020-04-28T12:54:56.931 INFO:teuthology.orchestra.run.smithi026.stderr: 46400K .......... .......... .......... .......... .......... 49% 121M 1s 2020-04-28T12:54:56.931 INFO:teuthology.orchestra.run.smithi026.stderr: 46450K .......... .......... .......... .......... .......... 50% 105M 1s 2020-04-28T12:54:56.931 INFO:teuthology.orchestra.run.smithi026.stderr: 46500K .......... .......... .......... .......... .......... 50% 102M 1s 2020-04-28T12:54:56.931 INFO:teuthology.orchestra.run.smithi026.stderr: 46550K .......... .......... .......... .......... .......... 50% 111M 1s 2020-04-28T12:54:56.931 INFO:teuthology.orchestra.run.smithi026.stderr: 46600K .......... .......... .......... .......... .......... 50% 144M 1s 2020-04-28T12:54:56.931 INFO:teuthology.orchestra.run.smithi026.stderr: 46650K .......... .......... .......... .......... .......... 50% 102M 1s 2020-04-28T12:54:56.932 INFO:teuthology.orchestra.run.smithi026.stderr: 46700K .......... .......... .......... .......... .......... 50% 129M 1s 2020-04-28T12:54:56.932 INFO:teuthology.orchestra.run.smithi026.stderr: 46750K .......... .......... .......... .......... .......... 50% 77.9M 1s 2020-04-28T12:54:56.932 INFO:teuthology.orchestra.run.smithi026.stderr: 46800K .......... .......... .......... .......... .......... 50% 147M 1s 2020-04-28T12:54:56.932 INFO:teuthology.orchestra.run.smithi026.stderr: 46850K .......... .......... .......... .......... .......... 50% 112M 1s 2020-04-28T12:54:56.933 INFO:teuthology.orchestra.run.smithi026.stderr: 46900K .......... .......... .......... .......... .......... 50% 114M 1s 2020-04-28T12:54:56.933 INFO:teuthology.orchestra.run.smithi026.stderr: 46950K .......... .......... .......... .......... .......... 50% 92.9M 1s 2020-04-28T12:54:56.933 INFO:teuthology.orchestra.run.smithi026.stderr: 47000K .......... .......... .......... .......... .......... 50% 126M 1s 2020-04-28T12:54:56.933 INFO:teuthology.orchestra.run.smithi026.stderr: 47050K .......... .......... .......... .......... .......... 50% 126M 1s 2020-04-28T12:54:56.933 INFO:teuthology.orchestra.run.smithi026.stderr: 47100K .......... .......... .......... .......... .......... 50% 93.9M 1s 2020-04-28T12:54:56.934 INFO:teuthology.orchestra.run.smithi026.stderr: 47150K .......... .......... .......... .......... .......... 50% 99.0M 1s 2020-04-28T12:54:56.934 INFO:teuthology.orchestra.run.smithi026.stderr: 47200K .......... .......... .......... .......... .......... 50% 63.3M 1s 2020-04-28T12:54:56.934 INFO:teuthology.orchestra.run.smithi026.stderr: 47250K .......... .......... .......... .......... .......... 50% 48.4M 1s 2020-04-28T12:54:56.934 INFO:teuthology.orchestra.run.smithi026.stderr: 47300K .......... .......... .......... .......... .......... 50% 50.3M 1s 2020-04-28T12:54:56.934 INFO:teuthology.orchestra.run.smithi026.stderr: 47350K .......... .......... .......... .......... .......... 51% 88.5M 1s 2020-04-28T12:54:56.934 INFO:teuthology.orchestra.run.smithi026.stderr: 47400K .......... .......... .......... .......... .......... 51% 127M 1s 2020-04-28T12:54:56.934 INFO:teuthology.orchestra.run.smithi026.stderr: 47450K .......... .......... .......... .......... .......... 51% 57.8M 1s 2020-04-28T12:54:56.935 INFO:teuthology.orchestra.run.smithi026.stderr: 47500K .......... .......... .......... .......... .......... 51% 50.4M 1s 2020-04-28T12:54:56.935 INFO:teuthology.orchestra.run.smithi026.stderr: 47550K .......... .......... .......... .......... .......... 51% 45.4M 1s 2020-04-28T12:54:56.935 INFO:teuthology.orchestra.run.smithi026.stderr: 47600K .......... .......... .......... .......... .......... 51% 86.3M 1s 2020-04-28T12:54:56.935 INFO:teuthology.orchestra.run.smithi026.stderr: 47650K .......... .......... .......... .......... .......... 51% 112M 1s 2020-04-28T12:54:56.935 INFO:teuthology.orchestra.run.smithi026.stderr: 47700K .......... .......... .......... .......... .......... 51% 100M 1s 2020-04-28T12:54:56.935 INFO:teuthology.orchestra.run.smithi026.stderr: 47750K .......... .......... .......... .......... .......... 51% 112M 1s 2020-04-28T12:54:56.936 INFO:teuthology.orchestra.run.smithi026.stderr: 47800K .......... .......... .......... .......... .......... 51% 108M 1s 2020-04-28T12:54:56.936 INFO:teuthology.orchestra.run.smithi026.stderr: 47850K .......... .......... .......... .......... .......... 51% 117M 1s 2020-04-28T12:54:56.936 INFO:teuthology.orchestra.run.smithi026.stderr: 47900K .......... .......... .......... .......... .......... 51% 134M 1s 2020-04-28T12:54:56.936 INFO:teuthology.orchestra.run.smithi026.stderr: 47950K .......... .......... .......... .......... .......... 51% 84.6M 1s 2020-04-28T12:54:56.936 INFO:teuthology.orchestra.run.smithi026.stderr: 48000K .......... .......... .......... .......... .......... 51% 109M 1s 2020-04-28T12:54:56.936 INFO:teuthology.orchestra.run.smithi026.stderr: 48050K .......... .......... .......... .......... .......... 51% 131M 1s 2020-04-28T12:54:56.937 INFO:teuthology.orchestra.run.smithi026.stderr: 48100K .......... .......... .......... .......... .......... 51% 93.9M 1s 2020-04-28T12:54:56.937 INFO:teuthology.orchestra.run.smithi026.stderr: 48150K .......... .......... .......... .......... .......... 51% 113M 1s 2020-04-28T12:54:56.937 INFO:teuthology.orchestra.run.smithi026.stderr: 48200K .......... .......... .......... .......... .......... 51% 129M 1s 2020-04-28T12:54:56.937 INFO:teuthology.orchestra.run.smithi026.stderr: 48250K .......... .......... .......... .......... .......... 51% 95.7M 1s 2020-04-28T12:54:56.937 INFO:teuthology.orchestra.run.smithi026.stderr: 48300K .......... .......... .......... .......... .......... 52% 127M 1s 2020-04-28T12:54:56.937 INFO:teuthology.orchestra.run.smithi026.stderr: 48350K .......... .......... .......... .......... .......... 52% 97.8M 1s 2020-04-28T12:54:56.937 INFO:teuthology.orchestra.run.smithi026.stderr: 48400K .......... .......... .......... .......... .......... 52% 126M 1s 2020-04-28T12:54:56.938 INFO:teuthology.orchestra.run.smithi026.stderr: 48450K .......... .......... .......... .......... .......... 52% 94.5M 1s 2020-04-28T12:54:56.938 INFO:teuthology.orchestra.run.smithi026.stderr: 48500K .......... .......... .......... .......... .......... 52% 126M 1s 2020-04-28T12:54:56.938 INFO:teuthology.orchestra.run.smithi026.stderr: 48550K .......... .......... .......... .......... .......... 52% 122M 1s 2020-04-28T12:54:56.938 INFO:teuthology.orchestra.run.smithi026.stderr: 48600K .......... .......... .......... .......... .......... 52% 123M 1s 2020-04-28T12:54:56.938 INFO:teuthology.orchestra.run.smithi026.stderr: 48650K .......... .......... .......... .......... .......... 52% 95.7M 1s 2020-04-28T12:54:56.938 INFO:teuthology.orchestra.run.smithi026.stderr: 48700K .......... .......... .......... .......... .......... 52% 128M 1s 2020-04-28T12:54:56.939 INFO:teuthology.orchestra.run.smithi026.stderr: 48750K .......... .......... .......... .......... .......... 52% 80.9M 1s 2020-04-28T12:54:56.939 INFO:teuthology.orchestra.run.smithi026.stderr: 48800K .......... .......... .......... .......... .......... 52% 118M 1s 2020-04-28T12:54:56.939 INFO:teuthology.orchestra.run.smithi026.stderr: 48850K .......... .......... .......... .......... .......... 52% 126M 1s 2020-04-28T12:54:56.939 INFO:teuthology.orchestra.run.smithi026.stderr: 48900K .......... .......... .......... .......... .......... 52% 126M 1s 2020-04-28T12:54:56.939 INFO:teuthology.orchestra.run.smithi026.stderr: 48950K .......... .......... .......... .......... .......... 52% 50.7M 1s 2020-04-28T12:54:56.939 INFO:teuthology.orchestra.run.smithi026.stderr: 49000K .......... .......... .......... .......... .......... 52% 115M 1s 2020-04-28T12:54:56.939 INFO:teuthology.orchestra.run.smithi026.stderr: 49050K .......... .......... .......... .......... .......... 52% 70.4M 1s 2020-04-28T12:54:56.940 INFO:teuthology.orchestra.run.smithi026.stderr: 49100K .......... .......... .......... .......... .......... 52% 102M 1s 2020-04-28T12:54:56.940 INFO:teuthology.orchestra.run.smithi026.stderr: 49150K .......... .......... .......... .......... .......... 52% 61.4M 1s 2020-04-28T12:54:56.940 INFO:teuthology.orchestra.run.smithi026.stderr: 49200K .......... .......... .......... .......... .......... 53% 137M 1s 2020-04-28T12:54:56.940 INFO:teuthology.orchestra.run.smithi026.stderr: 49250K .......... .......... .......... .......... .......... 53% 65.1M 1s 2020-04-28T12:54:56.940 INFO:teuthology.orchestra.run.smithi026.stderr: 49300K .......... .......... .......... .......... .......... 53% 120M 1s 2020-04-28T12:54:56.940 INFO:teuthology.orchestra.run.smithi026.stderr: 49350K .......... .......... .......... .......... .......... 53% 118M 1s 2020-04-28T12:54:56.941 INFO:teuthology.orchestra.run.smithi026.stderr: 49400K .......... .......... .......... .......... .......... 53% 107M 1s 2020-04-28T12:54:56.941 INFO:teuthology.orchestra.run.smithi026.stderr: 49450K .......... .......... .......... .......... .......... 53% 124M 1s 2020-04-28T12:54:56.941 INFO:teuthology.orchestra.run.smithi026.stderr: 49500K .......... .......... .......... .......... .......... 53% 112M 1s 2020-04-28T12:54:56.941 INFO:teuthology.orchestra.run.smithi026.stderr: 49550K .......... .......... .......... .......... .......... 53% 54.7M 1s 2020-04-28T12:54:56.941 INFO:teuthology.orchestra.run.smithi026.stderr: 49600K .......... .......... .......... .......... .......... 53% 68.5M 1s 2020-04-28T12:54:56.941 INFO:teuthology.orchestra.run.smithi026.stderr: 49650K .......... .......... .......... .......... .......... 53% 96.5M 1s 2020-04-28T12:54:56.941 INFO:teuthology.orchestra.run.smithi026.stderr: 49700K .......... .......... .......... .......... .......... 53% 91.8M 1s 2020-04-28T12:54:56.942 INFO:teuthology.orchestra.run.smithi026.stderr: 49750K .......... .......... .......... .......... .......... 53% 62.2M 1s 2020-04-28T12:54:56.942 INFO:teuthology.orchestra.run.smithi026.stderr: 49800K .......... .......... .......... .......... .......... 53% 77.3M 1s 2020-04-28T12:54:56.942 INFO:teuthology.orchestra.run.smithi026.stderr: 49850K .......... .......... .......... .......... .......... 53% 110M 1s 2020-04-28T12:54:56.942 INFO:teuthology.orchestra.run.smithi026.stderr: 49900K .......... .......... .......... .......... .......... 53% 109M 1s 2020-04-28T12:54:56.942 INFO:teuthology.orchestra.run.smithi026.stderr: 49950K .......... .......... .......... .......... .......... 53% 98.3M 1s 2020-04-28T12:54:56.943 INFO:teuthology.orchestra.run.smithi026.stderr: 50000K .......... .......... .......... .......... .......... 53% 118M 1s 2020-04-28T12:54:56.943 INFO:teuthology.orchestra.run.smithi026.stderr: 50050K .......... .......... .......... .......... .......... 53% 109M 1s 2020-04-28T12:54:56.943 INFO:teuthology.orchestra.run.smithi026.stderr: 50100K .......... .......... .......... .......... .......... 53% 118M 1s 2020-04-28T12:54:56.943 INFO:teuthology.orchestra.run.smithi026.stderr: 50150K .......... .......... .......... .......... .......... 54% 108M 1s 2020-04-28T12:54:56.943 INFO:teuthology.orchestra.run.smithi026.stderr: 50200K .......... .......... .......... .......... .......... 54% 117M 1s 2020-04-28T12:54:56.944 INFO:teuthology.orchestra.run.smithi026.stderr: 50250K .......... .......... .......... .......... .......... 54% 119M 1s 2020-04-28T12:54:56.944 INFO:teuthology.orchestra.run.smithi026.stderr: 50300K .......... .......... .......... .......... .......... 54% 119M 1s 2020-04-28T12:54:56.944 INFO:teuthology.orchestra.run.smithi026.stderr: 50350K .......... .......... .......... .......... .......... 54% 90.5M 1s 2020-04-28T12:54:56.944 INFO:teuthology.orchestra.run.smithi026.stderr: 50400K .......... .......... .......... .......... .......... 54% 116M 1s 2020-04-28T12:54:56.944 INFO:teuthology.orchestra.run.smithi026.stderr: 50450K .......... .......... .......... .......... .......... 54% 114M 1s 2020-04-28T12:54:56.944 INFO:teuthology.orchestra.run.smithi026.stderr: 50500K .......... .......... .......... .......... .......... 54% 112M 1s 2020-04-28T12:54:56.945 INFO:teuthology.orchestra.run.smithi026.stderr: 50550K .......... .......... .......... .......... .......... 54% 115M 1s 2020-04-28T12:54:56.945 INFO:teuthology.orchestra.run.smithi026.stderr: 50600K .......... .......... .......... .......... .......... 54% 62.9M 1s 2020-04-28T12:54:56.945 INFO:teuthology.orchestra.run.smithi026.stderr: 50650K .......... .......... .......... .......... .......... 54% 79.2M 1s 2020-04-28T12:54:56.945 INFO:teuthology.orchestra.run.smithi026.stderr: 50700K .......... .......... .......... .......... .......... 54% 63.8M 1s 2020-04-28T12:54:56.945 INFO:teuthology.orchestra.run.smithi026.stderr: 50750K .......... .......... .......... .......... .......... 54% 65.7M 1s 2020-04-28T12:54:56.945 INFO:teuthology.orchestra.run.smithi026.stderr: 50800K .......... .......... .......... .......... .......... 54% 113M 1s 2020-04-28T12:54:56.945 INFO:teuthology.orchestra.run.smithi026.stderr: 50850K .......... .......... .......... .......... .......... 54% 114M 1s 2020-04-28T12:54:56.946 INFO:teuthology.orchestra.run.smithi026.stderr: 50900K .......... .......... .......... .......... .......... 54% 120M 1s 2020-04-28T12:54:56.946 INFO:teuthology.orchestra.run.smithi026.stderr: 50950K .......... .......... .......... .......... .......... 54% 113M 1s 2020-04-28T12:54:56.946 INFO:teuthology.orchestra.run.smithi026.stderr: 51000K .......... .......... .......... .......... .......... 54% 115M 1s 2020-04-28T12:54:56.946 INFO:teuthology.orchestra.run.smithi026.stderr: 51050K .......... .......... .......... .......... .......... 55% 114M 1s 2020-04-28T12:54:56.946 INFO:teuthology.orchestra.run.smithi026.stderr: 51100K .......... .......... .......... .......... .......... 55% 120M 1s 2020-04-28T12:54:56.947 INFO:teuthology.orchestra.run.smithi026.stderr: 51150K .......... .......... .......... .......... .......... 55% 55.7M 1s 2020-04-28T12:54:56.947 INFO:teuthology.orchestra.run.smithi026.stderr: 51200K .......... .......... .......... .......... .......... 55% 76.8M 1s 2020-04-28T12:54:56.947 INFO:teuthology.orchestra.run.smithi026.stderr: 51250K .......... .......... .......... .......... .......... 55% 64.8M 1s 2020-04-28T12:54:56.947 INFO:teuthology.orchestra.run.smithi026.stderr: 51300K .......... .......... .......... .......... .......... 55% 116M 1s 2020-04-28T12:54:56.947 INFO:teuthology.orchestra.run.smithi026.stderr: 51350K .......... .......... .......... .......... .......... 55% 76.6M 1s 2020-04-28T12:54:56.947 INFO:teuthology.orchestra.run.smithi026.stderr: 51400K .......... .......... .......... .......... .......... 55% 64.5M 1s 2020-04-28T12:54:56.947 INFO:teuthology.orchestra.run.smithi026.stderr: 51450K .......... .......... .......... .......... .......... 55% 72.5M 1s 2020-04-28T12:54:56.948 INFO:teuthology.orchestra.run.smithi026.stderr: 51500K .......... .......... .......... .......... .......... 55% 67.4M 1s 2020-04-28T12:54:56.948 INFO:teuthology.orchestra.run.smithi026.stderr: 51550K .......... .......... .......... .......... .......... 55% 91.6M 1s 2020-04-28T12:54:56.948 INFO:teuthology.orchestra.run.smithi026.stderr: 51600K .......... .......... .......... .......... .......... 55% 78.5M 1s 2020-04-28T12:54:56.948 INFO:teuthology.orchestra.run.smithi026.stderr: 51650K .......... .......... .......... .......... .......... 55% 113M 1s 2020-04-28T12:54:56.948 INFO:teuthology.orchestra.run.smithi026.stderr: 51700K .......... .......... .......... .......... .......... 55% 113M 1s 2020-04-28T12:54:56.948 INFO:teuthology.orchestra.run.smithi026.stderr: 51750K .......... .......... .......... .......... .......... 55% 105M 1s 2020-04-28T12:54:56.949 INFO:teuthology.orchestra.run.smithi026.stderr: 51800K .......... .......... .......... .......... .......... 55% 120M 1s 2020-04-28T12:54:56.949 INFO:teuthology.orchestra.run.smithi026.stderr: 51850K .......... .......... .......... .......... .......... 55% 114M 1s 2020-04-28T12:54:56.949 INFO:teuthology.orchestra.run.smithi026.stderr: 51900K .......... .......... .......... .......... .......... 55% 122M 1s 2020-04-28T12:54:56.949 INFO:teuthology.orchestra.run.smithi026.stderr: 51950K .......... .......... .......... .......... .......... 55% 83.9M 1s 2020-04-28T12:54:56.949 INFO:teuthology.orchestra.run.smithi026.stderr: 52000K .......... .......... .......... .......... .......... 56% 118M 1s 2020-04-28T12:54:56.949 INFO:teuthology.orchestra.run.smithi026.stderr: 52050K .......... .......... .......... .......... .......... 56% 107M 1s 2020-04-28T12:54:56.949 INFO:teuthology.orchestra.run.smithi026.stderr: 52100K .......... .......... .......... .......... .......... 56% 127M 1s 2020-04-28T12:54:56.950 INFO:teuthology.orchestra.run.smithi026.stderr: 52150K .......... .......... .......... .......... .......... 56% 49.4M 1s 2020-04-28T12:54:56.950 INFO:teuthology.orchestra.run.smithi026.stderr: 52200K .......... .......... .......... .......... .......... 56% 64.1M 1s 2020-04-28T12:54:56.950 INFO:teuthology.orchestra.run.smithi026.stderr: 52250K .......... .......... .......... .......... .......... 56% 121M 1s 2020-04-28T12:54:56.950 INFO:teuthology.orchestra.run.smithi026.stderr: 52300K .......... .......... .......... .......... .......... 56% 112M 1s 2020-04-28T12:54:56.950 INFO:teuthology.orchestra.run.smithi026.stderr: 52350K .......... .......... .......... .......... .......... 56% 87.7M 1s 2020-04-28T12:54:56.950 INFO:teuthology.orchestra.run.smithi026.stderr: 52400K .......... .......... .......... .......... .......... 56% 118M 1s 2020-04-28T12:54:56.951 INFO:teuthology.orchestra.run.smithi026.stderr: 52450K .......... .......... .......... .......... .......... 56% 112M 1s 2020-04-28T12:54:56.951 INFO:teuthology.orchestra.run.smithi026.stderr: 52500K .......... .......... .......... .......... .......... 56% 121M 1s 2020-04-28T12:54:56.951 INFO:teuthology.orchestra.run.smithi026.stderr: 52550K .......... .......... .......... .......... .......... 56% 110M 1s 2020-04-28T12:54:56.951 INFO:teuthology.orchestra.run.smithi026.stderr: 52600K .......... .......... .......... .......... .......... 56% 120M 1s 2020-04-28T12:54:56.951 INFO:teuthology.orchestra.run.smithi026.stderr: 52650K .......... .......... .......... .......... .......... 56% 106M 1s 2020-04-28T12:54:56.951 INFO:teuthology.orchestra.run.smithi026.stderr: 52700K .......... .......... .......... .......... .......... 56% 50.2M 1s 2020-04-28T12:54:56.952 INFO:teuthology.orchestra.run.smithi026.stderr: 52750K .......... .......... .......... .......... .......... 56% 92.2M 1s 2020-04-28T12:54:56.952 INFO:teuthology.orchestra.run.smithi026.stderr: 52800K .......... .......... .......... .......... .......... 56% 82.1M 1s 2020-04-28T12:54:56.952 INFO:teuthology.orchestra.run.smithi026.stderr: 52850K .......... .......... .......... .......... .......... 56% 59.7M 1s 2020-04-28T12:54:56.952 INFO:teuthology.orchestra.run.smithi026.stderr: 52900K .......... .......... .......... .......... .......... 56% 109M 1s 2020-04-28T12:54:56.952 INFO:teuthology.orchestra.run.smithi026.stderr: 52950K .......... .......... .......... .......... .......... 57% 81.4M 1s 2020-04-28T12:54:56.952 INFO:teuthology.orchestra.run.smithi026.stderr: 53000K .......... .......... .......... .......... .......... 57% 116M 1s 2020-04-28T12:54:56.953 INFO:teuthology.orchestra.run.smithi026.stderr: 53050K .......... .......... .......... .......... .......... 57% 64.7M 1s 2020-04-28T12:54:56.953 INFO:teuthology.orchestra.run.smithi026.stderr: 53100K .......... .......... .......... .......... .......... 57% 76.7M 1s 2020-04-28T12:54:56.953 INFO:teuthology.orchestra.run.smithi026.stderr: 53150K .......... .......... .......... .......... .......... 57% 53.3M 1s 2020-04-28T12:54:56.954 INFO:teuthology.orchestra.run.smithi026.stderr: 53200K .......... .......... .......... .......... .......... 57% 71.0M 1s 2020-04-28T12:54:56.954 INFO:teuthology.orchestra.run.smithi026.stderr: 53250K .......... .......... .......... .......... .......... 57% 63.9M 1s 2020-04-28T12:54:56.954 INFO:teuthology.orchestra.run.smithi026.stderr: 53300K .......... .......... .......... .......... .......... 57% 114M 1s 2020-04-28T12:54:56.954 INFO:teuthology.orchestra.run.smithi026.stderr: 53350K .......... .......... .......... .......... .......... 57% 74.1M 1s 2020-04-28T12:54:56.954 INFO:teuthology.orchestra.run.smithi026.stderr: 53400K .......... .......... .......... .......... .......... 57% 67.9M 1s 2020-04-28T12:54:56.955 INFO:teuthology.orchestra.run.smithi026.stderr: 53450K .......... .......... .......... .......... .......... 57% 118M 1s 2020-04-28T12:54:56.955 INFO:teuthology.orchestra.run.smithi026.stderr: 53500K .......... .......... .......... .......... .......... 57% 115M 1s 2020-04-28T12:54:56.955 INFO:teuthology.orchestra.run.smithi026.stderr: 53550K .......... .......... .......... .......... .......... 57% 60.4M 1s 2020-04-28T12:54:56.955 INFO:teuthology.orchestra.run.smithi026.stderr: 53600K .......... .......... .......... .......... .......... 57% 69.1M 1s 2020-04-28T12:54:56.955 INFO:teuthology.orchestra.run.smithi026.stderr: 53650K .......... .......... .......... .......... .......... 57% 77.3M 1s 2020-04-28T12:54:56.955 INFO:teuthology.orchestra.run.smithi026.stderr: 53700K .......... .......... .......... .......... .......... 57% 64.5M 1s 2020-04-28T12:54:56.956 INFO:teuthology.orchestra.run.smithi026.stderr: 53750K .......... .......... .......... .......... .......... 57% 112M 1s 2020-04-28T12:54:56.956 INFO:teuthology.orchestra.run.smithi026.stderr: 53800K .......... .......... .......... .......... .......... 57% 66.9M 1s 2020-04-28T12:54:56.956 INFO:teuthology.orchestra.run.smithi026.stderr: 53850K .......... .......... .......... .......... .......... 58% 65.0M 1s 2020-04-28T12:54:56.956 INFO:teuthology.orchestra.run.smithi026.stderr: 53900K .......... .......... .......... .......... .......... 58% 79.0M 1s 2020-04-28T12:54:56.956 INFO:teuthology.orchestra.run.smithi026.stderr: 53950K .......... .......... .......... .......... .......... 58% 56.4M 1s 2020-04-28T12:54:56.956 INFO:teuthology.orchestra.run.smithi026.stderr: 54000K .......... .......... .......... .......... .......... 58% 120M 1s 2020-04-28T12:54:56.956 INFO:teuthology.orchestra.run.smithi026.stderr: 54050K .......... .......... .......... .......... .......... 58% 110M 1s 2020-04-28T12:54:56.957 INFO:teuthology.orchestra.run.smithi026.stderr: 54100K .......... .......... .......... .......... .......... 58% 76.3M 1s 2020-04-28T12:54:56.957 INFO:teuthology.orchestra.run.smithi026.stderr: 54150K .......... .......... .......... .......... .......... 58% 64.0M 1s 2020-04-28T12:54:56.957 INFO:teuthology.orchestra.run.smithi026.stderr: 54200K .......... .......... .......... .......... .......... 58% 77.1M 1s 2020-04-28T12:54:56.957 INFO:teuthology.orchestra.run.smithi026.stderr: 54250K .......... .......... .......... .......... .......... 58% 119M 1s 2020-04-28T12:54:56.957 INFO:teuthology.orchestra.run.smithi026.stderr: 54300K .......... .......... .......... .......... .......... 58% 63.9M 1s 2020-04-28T12:54:56.957 INFO:teuthology.orchestra.run.smithi026.stderr: 54350K .......... .......... .......... .......... .......... 58% 64.7M 1s 2020-04-28T12:54:56.958 INFO:teuthology.orchestra.run.smithi026.stderr: 54400K .......... .......... .......... .......... .......... 58% 65.5M 1s 2020-04-28T12:54:56.958 INFO:teuthology.orchestra.run.smithi026.stderr: 54450K .......... .......... .......... .......... .......... 58% 77.9M 1s 2020-04-28T12:54:56.958 INFO:teuthology.orchestra.run.smithi026.stderr: 54500K .......... .......... .......... .......... .......... 58% 114M 1s 2020-04-28T12:54:56.958 INFO:teuthology.orchestra.run.smithi026.stderr: 54550K .......... .......... .......... .......... .......... 58% 64.1M 1s 2020-04-28T12:54:56.958 INFO:teuthology.orchestra.run.smithi026.stderr: 54600K .......... .......... .......... .......... .......... 58% 114M 1s 2020-04-28T12:54:56.958 INFO:teuthology.orchestra.run.smithi026.stderr: 54650K .......... .......... .......... .......... .......... 58% 77.7M 1s 2020-04-28T12:54:56.959 INFO:teuthology.orchestra.run.smithi026.stderr: 54700K .......... .......... .......... .......... .......... 58% 70.2M 1s 2020-04-28T12:54:56.959 INFO:teuthology.orchestra.run.smithi026.stderr: 54750K .......... .......... .......... .......... .......... 58% 83.4M 1s 2020-04-28T12:54:56.959 INFO:teuthology.orchestra.run.smithi026.stderr: 54800K .......... .......... .......... .......... .......... 59% 72.2M 1s 2020-04-28T12:54:56.959 INFO:teuthology.orchestra.run.smithi026.stderr: 54850K .......... .......... .......... .......... .......... 59% 67.0M 0s 2020-04-28T12:54:56.959 INFO:teuthology.orchestra.run.smithi026.stderr: 54900K .......... .......... .......... .......... .......... 59% 78.5M 0s 2020-04-28T12:54:56.959 INFO:teuthology.orchestra.run.smithi026.stderr: 54950K .......... .......... .......... .......... .......... 59% 62.0M 0s 2020-04-28T12:54:56.959 INFO:teuthology.orchestra.run.smithi026.stderr: 55000K .......... .......... .......... .......... .......... 59% 123M 0s 2020-04-28T12:54:56.960 INFO:teuthology.orchestra.run.smithi026.stderr: 55050K .......... .......... .......... .......... .......... 59% 74.7M 0s 2020-04-28T12:54:56.960 INFO:teuthology.orchestra.run.smithi026.stderr: 55100K .......... .......... .......... .......... .......... 59% 64.9M 0s 2020-04-28T12:54:56.960 INFO:teuthology.orchestra.run.smithi026.stderr: 55150K .......... .......... .......... .......... .......... 59% 87.3M 0s 2020-04-28T12:54:56.960 INFO:teuthology.orchestra.run.smithi026.stderr: 55200K .......... .......... .......... .......... .......... 59% 80.1M 0s 2020-04-28T12:54:56.960 INFO:teuthology.orchestra.run.smithi026.stderr: 55250K .......... .......... .......... .......... .......... 59% 119M 0s 2020-04-28T12:54:56.960 INFO:teuthology.orchestra.run.smithi026.stderr: 55300K .......... .......... .......... .......... .......... 59% 62.1M 0s 2020-04-28T12:54:56.960 INFO:teuthology.orchestra.run.smithi026.stderr: 55350K .......... .......... .......... .......... .......... 59% 76.0M 0s 2020-04-28T12:54:56.961 INFO:teuthology.orchestra.run.smithi026.stderr: 55400K .......... .......... .......... .......... .......... 59% 64.4M 0s 2020-04-28T12:54:56.961 INFO:teuthology.orchestra.run.smithi026.stderr: 55450K .......... .......... .......... .......... .......... 59% 120M 0s 2020-04-28T12:54:56.961 INFO:teuthology.orchestra.run.smithi026.stderr: 55500K .......... .......... .......... .......... .......... 59% 75.8M 0s 2020-04-28T12:54:56.961 INFO:teuthology.orchestra.run.smithi026.stderr: 55550K .......... .......... .......... .......... .......... 59% 55.6M 0s 2020-04-28T12:54:56.961 INFO:teuthology.orchestra.run.smithi026.stderr: 55600K .......... .......... .......... .......... .......... 59% 70.7M 0s 2020-04-28T12:54:56.962 INFO:teuthology.orchestra.run.smithi026.stderr: 55650K .......... .......... .......... .......... .......... 59% 69.7M 0s 2020-04-28T12:54:56.962 INFO:teuthology.orchestra.run.smithi026.stderr: 55700K .......... .......... .......... .......... .......... 60% 114M 0s 2020-04-28T12:54:56.962 INFO:teuthology.orchestra.run.smithi026.stderr: 55750K .......... .......... .......... .......... .......... 60% 116M 0s 2020-04-28T12:54:56.962 INFO:teuthology.orchestra.run.smithi026.stderr: 55800K .......... .......... .......... .......... .......... 60% 73.1M 0s 2020-04-28T12:54:56.962 INFO:teuthology.orchestra.run.smithi026.stderr: 55850K .......... .......... .......... .......... .......... 60% 66.2M 0s 2020-04-28T12:54:56.962 INFO:teuthology.orchestra.run.smithi026.stderr: 55900K .......... .......... .......... .......... .......... 60% 77.7M 0s 2020-04-28T12:54:56.963 INFO:teuthology.orchestra.run.smithi026.stderr: 55950K .......... .......... .......... .......... .......... 60% 55.9M 0s 2020-04-28T12:54:56.963 INFO:teuthology.orchestra.run.smithi026.stderr: 56000K .......... .......... .......... .......... .......... 60% 117M 0s 2020-04-28T12:54:56.963 INFO:teuthology.orchestra.run.smithi026.stderr: 56050K .......... .......... .......... .......... .......... 60% 75.6M 0s 2020-04-28T12:54:56.963 INFO:teuthology.orchestra.run.smithi026.stderr: 56100K .......... .......... .......... .......... .......... 60% 64.9M 0s 2020-04-28T12:54:56.963 INFO:teuthology.orchestra.run.smithi026.stderr: 56150K .......... .......... .......... .......... .......... 60% 86.1M 0s 2020-04-28T12:54:56.963 INFO:teuthology.orchestra.run.smithi026.stderr: 56200K .......... .......... .......... .......... .......... 60% 98.0M 0s 2020-04-28T12:54:56.963 INFO:teuthology.orchestra.run.smithi026.stderr: 56250K .......... .......... .......... .......... .......... 60% 64.1M 0s 2020-04-28T12:54:56.965 INFO:teuthology.orchestra.run.smithi026.stderr: 56300K .......... .......... .......... .......... .......... 60% 117M 0s 2020-04-28T12:54:56.965 INFO:teuthology.orchestra.run.smithi026.stderr: 56350K .......... .......... .......... .......... .......... 60% 64.0M 0s 2020-04-28T12:54:56.966 INFO:teuthology.orchestra.run.smithi026.stderr: 56400K .......... .......... .......... .......... .......... 60% 63.7M 0s 2020-04-28T12:54:56.966 INFO:teuthology.orchestra.run.smithi026.stderr: 56450K .......... .......... .......... .......... .......... 60% 122M 0s 2020-04-28T12:54:56.966 INFO:teuthology.orchestra.run.smithi026.stderr: 56500K .......... .......... .......... .......... .......... 60% 77.3M 0s 2020-04-28T12:54:56.966 INFO:teuthology.orchestra.run.smithi026.stderr: 56550K .......... .......... .......... .......... .......... 60% 59.4M 0s 2020-04-28T12:54:56.966 INFO:teuthology.orchestra.run.smithi026.stderr: 56600K .......... .......... .......... .......... .......... 60% 75.7M 0s 2020-04-28T12:54:56.966 INFO:teuthology.orchestra.run.smithi026.stderr: 56650K .......... .......... .......... .......... .......... 61% 64.9M 0s 2020-04-28T12:54:56.967 INFO:teuthology.orchestra.run.smithi026.stderr: 56700K .......... .......... .......... .......... .......... 61% 118M 0s 2020-04-28T12:54:56.967 INFO:teuthology.orchestra.run.smithi026.stderr: 56750K .......... .......... .......... .......... .......... 61% 67.4M 0s 2020-04-28T12:54:56.967 INFO:teuthology.orchestra.run.smithi026.stderr: 56800K .......... .......... .......... .......... .......... 61% 62.0M 0s 2020-04-28T12:54:56.967 INFO:teuthology.orchestra.run.smithi026.stderr: 56850K .......... .......... .......... .......... .......... 61% 113M 0s 2020-04-28T12:54:56.967 INFO:teuthology.orchestra.run.smithi026.stderr: 56900K .......... .......... .......... .......... .......... 61% 78.1M 0s 2020-04-28T12:54:56.967 INFO:teuthology.orchestra.run.smithi026.stderr: 56950K .......... .......... .......... .......... .......... 61% 107M 0s 2020-04-28T12:54:56.967 INFO:teuthology.orchestra.run.smithi026.stderr: 57000K .......... .......... .......... .......... .......... 61% 56.2M 0s 2020-04-28T12:54:56.968 INFO:teuthology.orchestra.run.smithi026.stderr: 57050K .......... .......... .......... .......... .......... 61% 98.2M 0s 2020-04-28T12:54:56.968 INFO:teuthology.orchestra.run.smithi026.stderr: 57100K .......... .......... .......... .......... .......... 61% 64.3M 0s 2020-04-28T12:54:56.968 INFO:teuthology.orchestra.run.smithi026.stderr: 57150K .......... .......... .......... .......... .......... 61% 91.1M 0s 2020-04-28T12:54:56.968 INFO:teuthology.orchestra.run.smithi026.stderr: 57200K .......... .......... .......... .......... .......... 61% 118M 0s 2020-04-28T12:54:56.968 INFO:teuthology.orchestra.run.smithi026.stderr: 57250K .......... .......... .......... .......... .......... 61% 74.7M 0s 2020-04-28T12:54:56.968 INFO:teuthology.orchestra.run.smithi026.stderr: 57300K .......... .......... .......... .......... .......... 61% 64.8M 0s 2020-04-28T12:54:56.969 INFO:teuthology.orchestra.run.smithi026.stderr: 57350K .......... .......... .......... .......... .......... 61% 117M 0s 2020-04-28T12:54:56.969 INFO:teuthology.orchestra.run.smithi026.stderr: 57400K .......... .......... .......... .......... .......... 61% 77.1M 0s 2020-04-28T12:54:56.969 INFO:teuthology.orchestra.run.smithi026.stderr: 57450K .......... .......... .......... .......... .......... 61% 115M 0s 2020-04-28T12:54:56.969 INFO:teuthology.orchestra.run.smithi026.stderr: 57500K .......... .......... .......... .......... .......... 61% 66.9M 0s 2020-04-28T12:54:56.969 INFO:teuthology.orchestra.run.smithi026.stderr: 57550K .......... .......... .......... .......... .......... 62% 88.7M 0s 2020-04-28T12:54:56.970 INFO:teuthology.orchestra.run.smithi026.stderr: 57600K .......... .......... .......... .......... .......... 62% 77.5M 0s 2020-04-28T12:54:56.970 INFO:teuthology.orchestra.run.smithi026.stderr: 57650K .......... .......... .......... .......... .......... 62% 63.3M 0s 2020-04-28T12:54:56.970 INFO:teuthology.orchestra.run.smithi026.stderr: 57700K .......... .......... .......... .......... .......... 62% 124M 0s 2020-04-28T12:54:56.970 INFO:teuthology.orchestra.run.smithi026.stderr: 57750K .......... .......... .......... .......... .......... 62% 74.3M 0s 2020-04-28T12:54:56.970 INFO:teuthology.orchestra.run.smithi026.stderr: 57800K .......... .......... .......... .......... .......... 62% 115M 0s 2020-04-28T12:54:56.970 INFO:teuthology.orchestra.run.smithi026.stderr: 57850K .......... .......... .......... .......... .......... 62% 62.1M 0s 2020-04-28T12:54:56.971 INFO:teuthology.orchestra.run.smithi026.stderr: 57900K .......... .......... .......... .......... .......... 62% 113M 0s 2020-04-28T12:54:56.971 INFO:teuthology.orchestra.run.smithi026.stderr: 57950K .......... .......... .......... .......... .......... 62% 67.0M 0s 2020-04-28T12:54:56.971 INFO:teuthology.orchestra.run.smithi026.stderr: 58000K .......... .......... .......... .......... .......... 62% 66.5M 0s 2020-04-28T12:54:56.971 INFO:teuthology.orchestra.run.smithi026.stderr: 58050K .......... .......... .......... .......... .......... 62% 118M 0s 2020-04-28T12:54:56.972 INFO:teuthology.orchestra.run.smithi026.stderr: 58100K .......... .......... .......... .......... .......... 62% 75.6M 0s 2020-04-28T12:54:56.972 INFO:teuthology.orchestra.run.smithi026.stderr: 58150K .......... .......... .......... .......... .......... 62% 107M 0s 2020-04-28T12:54:56.972 INFO:teuthology.orchestra.run.smithi026.stderr: 58200K .......... .......... .......... .......... .......... 62% 63.7M 0s 2020-04-28T12:54:56.972 INFO:teuthology.orchestra.run.smithi026.stderr: 58250K .......... .......... .......... .......... .......... 62% 129M 0s 2020-04-28T12:54:56.972 INFO:teuthology.orchestra.run.smithi026.stderr: 58300K .......... .......... .......... .......... .......... 62% 74.5M 0s 2020-04-28T12:54:56.972 INFO:teuthology.orchestra.run.smithi026.stderr: 58350K .......... .......... .......... .......... .......... 62% 57.5M 0s 2020-04-28T12:54:56.973 INFO:teuthology.orchestra.run.smithi026.stderr: 58400K .......... .......... .......... .......... .......... 62% 113M 0s 2020-04-28T12:54:56.973 INFO:teuthology.orchestra.run.smithi026.stderr: 58450K .......... .......... .......... .......... .......... 62% 121M 0s 2020-04-28T12:54:56.973 INFO:teuthology.orchestra.run.smithi026.stderr: 58500K .......... .......... .......... .......... .......... 63% 77.5M 0s 2020-04-28T12:54:56.973 INFO:teuthology.orchestra.run.smithi026.stderr: 58550K .......... .......... .......... .......... .......... 63% 63.3M 0s 2020-04-28T12:54:56.973 INFO:teuthology.orchestra.run.smithi026.stderr: 58600K .......... .......... .......... .......... .......... 63% 109M 0s 2020-04-28T12:54:56.973 INFO:teuthology.orchestra.run.smithi026.stderr: 58650K .......... .......... .......... .......... .......... 63% 110M 0s 2020-04-28T12:54:56.974 INFO:teuthology.orchestra.run.smithi026.stderr: 58700K .......... .......... .......... .......... .......... 63% 76.4M 0s 2020-04-28T12:54:56.974 INFO:teuthology.orchestra.run.smithi026.stderr: 58750K .......... .......... .......... .......... .......... 63% 55.4M 0s 2020-04-28T12:54:56.974 INFO:teuthology.orchestra.run.smithi026.stderr: 58800K .......... .......... .......... .......... .......... 63% 80.4M 0s 2020-04-28T12:54:56.974 INFO:teuthology.orchestra.run.smithi026.stderr: 58850K .......... .......... .......... .......... .......... 63% 85.7M 0s 2020-04-28T12:54:56.974 INFO:teuthology.orchestra.run.smithi026.stderr: 58900K .......... .......... .......... .......... .......... 63% 82.7M 0s 2020-04-28T12:54:56.974 INFO:teuthology.orchestra.run.smithi026.stderr: 58950K .......... .......... .......... .......... .......... 63% 112M 0s 2020-04-28T12:54:56.975 INFO:teuthology.orchestra.run.smithi026.stderr: 59000K .......... .......... .......... .......... .......... 63% 77.8M 0s 2020-04-28T12:54:56.975 INFO:teuthology.orchestra.run.smithi026.stderr: 59050K .......... .......... .......... .......... .......... 63% 62.5M 0s 2020-04-28T12:54:56.975 INFO:teuthology.orchestra.run.smithi026.stderr: 59100K .......... .......... .......... .......... .......... 63% 47.1M 0s 2020-04-28T12:54:56.975 INFO:teuthology.orchestra.run.smithi026.stderr: 59150K .......... .......... .......... .......... .......... 63% 73.9M 0s 2020-04-28T12:54:56.975 INFO:teuthology.orchestra.run.smithi026.stderr: 59200K .......... .......... .......... .......... .......... 63% 58.3M 0s 2020-04-28T12:54:56.975 INFO:teuthology.orchestra.run.smithi026.stderr: 59250K .......... .......... .......... .......... .......... 63% 109M 0s 2020-04-28T12:54:56.976 INFO:teuthology.orchestra.run.smithi026.stderr: 59300K .......... .......... .......... .......... .......... 63% 50.7M 0s 2020-04-28T12:54:56.976 INFO:teuthology.orchestra.run.smithi026.stderr: 59350K .......... .......... .......... .......... .......... 63% 50.8M 0s 2020-04-28T12:54:56.976 INFO:teuthology.orchestra.run.smithi026.stderr: 59400K .......... .......... .......... .......... .......... 63% 110M 0s 2020-04-28T12:54:56.976 INFO:teuthology.orchestra.run.smithi026.stderr: 59450K .......... .......... .......... .......... .......... 64% 89.5M 0s 2020-04-28T12:54:56.976 INFO:teuthology.orchestra.run.smithi026.stderr: 59500K .......... .......... .......... .......... .......... 64% 58.4M 0s 2020-04-28T12:54:56.976 INFO:teuthology.orchestra.run.smithi026.stderr: 59550K .......... .......... .......... .......... .......... 64% 43.9M 0s 2020-04-28T12:54:56.976 INFO:teuthology.orchestra.run.smithi026.stderr: 59600K .......... .......... .......... .......... .......... 64% 51.3M 0s 2020-04-28T12:54:56.977 INFO:teuthology.orchestra.run.smithi026.stderr: 59650K .......... .......... .......... .......... .......... 64% 114M 0s 2020-04-28T12:54:56.977 INFO:teuthology.orchestra.run.smithi026.stderr: 59700K .......... .......... .......... .......... .......... 64% 88.7M 0s 2020-04-28T12:54:56.977 INFO:teuthology.orchestra.run.smithi026.stderr: 59750K .......... .......... .......... .......... .......... 64% 56.5M 0s 2020-04-28T12:54:56.977 INFO:teuthology.orchestra.run.smithi026.stderr: 59800K .......... .......... .......... .......... .......... 64% 49.9M 0s 2020-04-28T12:54:56.977 INFO:teuthology.orchestra.run.smithi026.stderr: 59850K .......... .......... .......... .......... .......... 64% 114M 0s 2020-04-28T12:54:56.977 INFO:teuthology.orchestra.run.smithi026.stderr: 59900K .......... .......... .......... .......... .......... 64% 47.1M 0s 2020-04-28T12:54:56.978 INFO:teuthology.orchestra.run.smithi026.stderr: 59950K .......... .......... .......... .......... .......... 64% 79.4M 0s 2020-04-28T12:54:56.978 INFO:teuthology.orchestra.run.smithi026.stderr: 60000K .......... .......... .......... .......... .......... 64% 57.4M 0s 2020-04-28T12:54:56.978 INFO:teuthology.orchestra.run.smithi026.stderr: 60050K .......... .......... .......... .......... .......... 64% 50.9M 0s 2020-04-28T12:54:56.978 INFO:teuthology.orchestra.run.smithi026.stderr: 60100K .......... .......... .......... .......... .......... 64% 82.5M 0s 2020-04-28T12:54:56.978 INFO:teuthology.orchestra.run.smithi026.stderr: 60150K .......... .......... .......... .......... .......... 64% 125M 0s 2020-04-28T12:54:56.978 INFO:teuthology.orchestra.run.smithi026.stderr: 60200K .......... .......... .......... .......... .......... 64% 73.1M 0s 2020-04-28T12:54:56.979 INFO:teuthology.orchestra.run.smithi026.stderr: 60250K .......... .......... .......... .......... .......... 64% 71.8M 0s 2020-04-28T12:54:56.979 INFO:teuthology.orchestra.run.smithi026.stderr: 60300K .......... .......... .......... .......... .......... 64% 65.7M 0s 2020-04-28T12:54:56.979 INFO:teuthology.orchestra.run.smithi026.stderr: 60350K .......... .......... .......... .......... .......... 65% 90.7M 0s 2020-04-28T12:54:56.979 INFO:teuthology.orchestra.run.smithi026.stderr: 60400K .......... .......... .......... .......... .......... 65% 113M 0s 2020-04-28T12:54:56.979 INFO:teuthology.orchestra.run.smithi026.stderr: 60450K .......... .......... .......... .......... .......... 65% 74.7M 0s 2020-04-28T12:54:56.979 INFO:teuthology.orchestra.run.smithi026.stderr: 60500K .......... .......... .......... .......... .......... 65% 66.7M 0s 2020-04-28T12:54:56.979 INFO:teuthology.orchestra.run.smithi026.stderr: 60550K .......... .......... .......... .......... .......... 65% 110M 0s 2020-04-28T12:54:56.980 INFO:teuthology.orchestra.run.smithi026.stderr: 60600K .......... .......... .......... .......... .......... 65% 122M 0s 2020-04-28T12:54:56.980 INFO:teuthology.orchestra.run.smithi026.stderr: 60650K .......... .......... .......... .......... .......... 65% 71.4M 0s 2020-04-28T12:54:56.980 INFO:teuthology.orchestra.run.smithi026.stderr: 60700K .......... .......... .......... .......... .......... 65% 66.1M 0s 2020-04-28T12:54:56.980 INFO:teuthology.orchestra.run.smithi026.stderr: 60750K .......... .......... .......... .......... .......... 65% 94.2M 0s 2020-04-28T12:54:56.980 INFO:teuthology.orchestra.run.smithi026.stderr: 60800K .......... .......... .......... .......... .......... 65% 70.1M 0s 2020-04-28T12:54:56.980 INFO:teuthology.orchestra.run.smithi026.stderr: 60850K .......... .......... .......... .......... .......... 65% 68.9M 0s 2020-04-28T12:54:56.981 INFO:teuthology.orchestra.run.smithi026.stderr: 60900K .......... .......... .......... .......... .......... 65% 115M 0s 2020-04-28T12:54:56.981 INFO:teuthology.orchestra.run.smithi026.stderr: 60950K .......... .......... .......... .......... .......... 65% 101M 0s 2020-04-28T12:54:56.981 INFO:teuthology.orchestra.run.smithi026.stderr: 61000K .......... .......... .......... .......... .......... 65% 80.1M 0s 2020-04-28T12:54:56.981 INFO:teuthology.orchestra.run.smithi026.stderr: 61050K .......... .......... .......... .......... .......... 65% 67.8M 0s 2020-04-28T12:54:56.981 INFO:teuthology.orchestra.run.smithi026.stderr: 61100K .......... .......... .......... .......... .......... 65% 118M 0s 2020-04-28T12:54:56.981 INFO:teuthology.orchestra.run.smithi026.stderr: 61150K .......... .......... .......... .......... .......... 65% 90.5M 0s 2020-04-28T12:54:56.981 INFO:teuthology.orchestra.run.smithi026.stderr: 61200K .......... .......... .......... .......... .......... 65% 73.5M 0s 2020-04-28T12:54:56.982 INFO:teuthology.orchestra.run.smithi026.stderr: 61250K .......... .......... .......... .......... .......... 65% 66.5M 0s 2020-04-28T12:54:56.982 INFO:teuthology.orchestra.run.smithi026.stderr: 61300K .......... .......... .......... .......... .......... 66% 120M 0s 2020-04-28T12:54:56.982 INFO:teuthology.orchestra.run.smithi026.stderr: 61350K .......... .......... .......... .......... .......... 66% 115M 0s 2020-04-28T12:54:56.982 INFO:teuthology.orchestra.run.smithi026.stderr: 61400K .......... .......... .......... .......... .......... 66% 69.3M 0s 2020-04-28T12:54:56.982 INFO:teuthology.orchestra.run.smithi026.stderr: 61450K .......... .......... .......... .......... .......... 66% 65.8M 0s 2020-04-28T12:54:56.982 INFO:teuthology.orchestra.run.smithi026.stderr: 61500K .......... .......... .......... .......... .......... 66% 125M 0s 2020-04-28T12:54:56.982 INFO:teuthology.orchestra.run.smithi026.stderr: 61550K .......... .......... .......... .......... .......... 66% 62.2M 0s 2020-04-28T12:54:56.983 INFO:teuthology.orchestra.run.smithi026.stderr: 61600K .......... .......... .......... .......... .......... 66% 121M 0s 2020-04-28T12:54:56.983 INFO:teuthology.orchestra.run.smithi026.stderr: 61650K .......... .......... .......... .......... .......... 66% 59.6M 0s 2020-04-28T12:54:56.983 INFO:teuthology.orchestra.run.smithi026.stderr: 61700K .......... .......... .......... .......... .......... 66% 118M 0s 2020-04-28T12:54:56.983 INFO:teuthology.orchestra.run.smithi026.stderr: 61750K .......... .......... .......... .......... .......... 66% 75.5M 0s 2020-04-28T12:54:56.983 INFO:teuthology.orchestra.run.smithi026.stderr: 61800K .......... .......... .......... .......... .......... 66% 63.5M 0s 2020-04-28T12:54:56.983 INFO:teuthology.orchestra.run.smithi026.stderr: 61850K .......... .......... .......... .......... .......... 66% 121M 0s 2020-04-28T12:54:56.984 INFO:teuthology.orchestra.run.smithi026.stderr: 61900K .......... .......... .......... .......... .......... 66% 73.9M 0s 2020-04-28T12:54:56.984 INFO:teuthology.orchestra.run.smithi026.stderr: 61950K .......... .......... .......... .......... .......... 66% 57.9M 0s 2020-04-28T12:54:56.984 INFO:teuthology.orchestra.run.smithi026.stderr: 62000K .......... .......... .......... .......... .......... 66% 76.7M 0s 2020-04-28T12:54:56.984 INFO:teuthology.orchestra.run.smithi026.stderr: 62050K .......... .......... .......... .......... .......... 66% 64.7M 0s 2020-04-28T12:54:56.984 INFO:teuthology.orchestra.run.smithi026.stderr: 62100K .......... .......... .......... .......... .......... 66% 117M 0s 2020-04-28T12:54:56.984 INFO:teuthology.orchestra.run.smithi026.stderr: 62150K .......... .......... .......... .......... .......... 66% 99.1M 0s 2020-04-28T12:54:56.984 INFO:teuthology.orchestra.run.smithi026.stderr: 62200K .......... .......... .......... .......... .......... 67% 59.6M 0s 2020-04-28T12:54:56.985 INFO:teuthology.orchestra.run.smithi026.stderr: 62250K .......... .......... .......... .......... .......... 67% 89.8M 0s 2020-04-28T12:54:56.985 INFO:teuthology.orchestra.run.smithi026.stderr: 62300K .......... .......... .......... .......... .......... 67% 123M 0s 2020-04-28T12:54:56.985 INFO:teuthology.orchestra.run.smithi026.stderr: 62350K .......... .......... .......... .......... .......... 67% 61.2M 0s 2020-04-28T12:54:56.985 INFO:teuthology.orchestra.run.smithi026.stderr: 62400K .......... .......... .......... .......... .......... 67% 65.5M 0s 2020-04-28T12:54:56.985 INFO:teuthology.orchestra.run.smithi026.stderr: 62450K .......... .......... .......... .......... .......... 67% 86.2M 0s 2020-04-28T12:54:56.985 INFO:teuthology.orchestra.run.smithi026.stderr: 62500K .......... .......... .......... .......... .......... 67% 56.1M 0s 2020-04-28T12:54:56.986 INFO:teuthology.orchestra.run.smithi026.stderr: 62550K .......... .......... .......... .......... .......... 67% 88.7M 0s 2020-04-28T12:54:56.986 INFO:teuthology.orchestra.run.smithi026.stderr: 62600K .......... .......... .......... .......... .......... 67% 137M 0s 2020-04-28T12:54:56.986 INFO:teuthology.orchestra.run.smithi026.stderr: 62650K .......... .......... .......... .......... .......... 67% 57.8M 0s 2020-04-28T12:54:56.986 INFO:teuthology.orchestra.run.smithi026.stderr: 62700K .......... .......... .......... .......... .......... 67% 117M 0s 2020-04-28T12:54:56.986 INFO:teuthology.orchestra.run.smithi026.stderr: 62750K .......... .......... .......... .......... .......... 67% 87.1M 0s 2020-04-28T12:54:56.986 INFO:teuthology.orchestra.run.smithi026.stderr: 62800K .......... .......... .......... .......... .......... 67% 92.3M 0s 2020-04-28T12:54:56.986 INFO:teuthology.orchestra.run.smithi026.stderr: 62850K .......... .......... .......... .......... .......... 67% 114M 0s 2020-04-28T12:54:56.987 INFO:teuthology.orchestra.run.smithi026.stderr: 62900K .......... .......... .......... .......... .......... 67% 115M 0s 2020-04-28T12:54:56.987 INFO:teuthology.orchestra.run.smithi026.stderr: 62950K .......... .......... .......... .......... .......... 67% 113M 0s 2020-04-28T12:54:56.987 INFO:teuthology.orchestra.run.smithi026.stderr: 63000K .......... .......... .......... .......... .......... 67% 116M 0s 2020-04-28T12:54:56.987 INFO:teuthology.orchestra.run.smithi026.stderr: 63050K .......... .......... .......... .......... .......... 67% 116M 0s 2020-04-28T12:54:56.987 INFO:teuthology.orchestra.run.smithi026.stderr: 63100K .......... .......... .......... .......... .......... 67% 115M 0s 2020-04-28T12:54:56.987 INFO:teuthology.orchestra.run.smithi026.stderr: 63150K .......... .......... .......... .......... .......... 68% 85.8M 0s 2020-04-28T12:54:56.988 INFO:teuthology.orchestra.run.smithi026.stderr: 63200K .......... .......... .......... .......... .......... 68% 120M 0s 2020-04-28T12:54:56.988 INFO:teuthology.orchestra.run.smithi026.stderr: 63250K .......... .......... .......... .......... .......... 68% 120M 0s 2020-04-28T12:54:56.988 INFO:teuthology.orchestra.run.smithi026.stderr: 63300K .......... .......... .......... .......... .......... 68% 112M 0s 2020-04-28T12:54:56.988 INFO:teuthology.orchestra.run.smithi026.stderr: 63350K .......... .......... .......... .......... .......... 68% 113M 0s 2020-04-28T12:54:56.988 INFO:teuthology.orchestra.run.smithi026.stderr: 63400K .......... .......... .......... .......... .......... 68% 112M 0s 2020-04-28T12:54:56.988 INFO:teuthology.orchestra.run.smithi026.stderr: 63450K .......... .......... .......... .......... .......... 68% 119M 0s 2020-04-28T12:54:56.988 INFO:teuthology.orchestra.run.smithi026.stderr: 63500K .......... .......... .......... .......... .......... 68% 117M 0s 2020-04-28T12:54:56.989 INFO:teuthology.orchestra.run.smithi026.stderr: 63550K .......... .......... .......... .......... .......... 68% 50.2M 0s 2020-04-28T12:54:56.989 INFO:teuthology.orchestra.run.smithi026.stderr: 63600K .......... .......... .......... .......... .......... 68% 116M 0s 2020-04-28T12:54:56.989 INFO:teuthology.orchestra.run.smithi026.stderr: 63650K .......... .......... .......... .......... .......... 68% 91.6M 0s 2020-04-28T12:54:56.989 INFO:teuthology.orchestra.run.smithi026.stderr: 63700K .......... .......... .......... .......... .......... 68% 56.6M 0s 2020-04-28T12:54:56.989 INFO:teuthology.orchestra.run.smithi026.stderr: 63750K .......... .......... .......... .......... .......... 68% 114M 0s 2020-04-28T12:54:56.990 INFO:teuthology.orchestra.run.smithi026.stderr: 63800K .......... .......... .......... .......... .......... 68% 118M 0s 2020-04-28T12:54:56.990 INFO:teuthology.orchestra.run.smithi026.stderr: 63850K .......... .......... .......... .......... .......... 68% 72.8M 0s 2020-04-28T12:54:56.990 INFO:teuthology.orchestra.run.smithi026.stderr: 63900K .......... .......... .......... .......... .......... 68% 65.6M 0s 2020-04-28T12:54:56.990 INFO:teuthology.orchestra.run.smithi026.stderr: 63950K .......... .......... .......... .......... .......... 68% 62.8M 0s 2020-04-28T12:54:56.990 INFO:teuthology.orchestra.run.smithi026.stderr: 64000K .......... .......... .......... .......... .......... 68% 64.6M 0s 2020-04-28T12:54:56.990 INFO:teuthology.orchestra.run.smithi026.stderr: 64050K .......... .......... .......... .......... .......... 68% 125M 0s 2020-04-28T12:54:56.991 INFO:teuthology.orchestra.run.smithi026.stderr: 64100K .......... .......... .......... .......... .......... 69% 73.6M 0s 2020-04-28T12:54:56.991 INFO:teuthology.orchestra.run.smithi026.stderr: 64150K .......... .......... .......... .......... .......... 69% 62.3M 0s 2020-04-28T12:54:56.991 INFO:teuthology.orchestra.run.smithi026.stderr: 64200K .......... .......... .......... .......... .......... 69% 74.0M 0s 2020-04-28T12:54:56.991 INFO:teuthology.orchestra.run.smithi026.stderr: 64250K .......... .......... .......... .......... .......... 69% 65.1M 0s 2020-04-28T12:54:56.991 INFO:teuthology.orchestra.run.smithi026.stderr: 64300K .......... .......... .......... .......... .......... 69% 111M 0s 2020-04-28T12:54:56.991 INFO:teuthology.orchestra.run.smithi026.stderr: 64350K .......... .......... .......... .......... .......... 69% 85.4M 0s 2020-04-28T12:54:56.992 INFO:teuthology.orchestra.run.smithi026.stderr: 64400K .......... .......... .......... .......... .......... 69% 26.4M 0s 2020-04-28T12:54:56.992 INFO:teuthology.orchestra.run.smithi026.stderr: 64450K .......... .......... .......... .......... .......... 69% 192M 0s 2020-04-28T12:54:56.992 INFO:teuthology.orchestra.run.smithi026.stderr: 64500K .......... .......... .......... .......... .......... 69% 194M 0s 2020-04-28T12:54:56.992 INFO:teuthology.orchestra.run.smithi026.stderr: 64550K .......... .......... .......... .......... .......... 69% 187M 0s 2020-04-28T12:54:56.992 INFO:teuthology.orchestra.run.smithi026.stderr: 64600K .......... .......... .......... .......... .......... 69% 191M 0s 2020-04-28T12:54:56.993 INFO:teuthology.orchestra.run.smithi026.stderr: 64650K .......... .......... .......... .......... .......... 69% 198M 0s 2020-04-28T12:54:56.993 INFO:teuthology.orchestra.run.smithi026.stderr: 64700K .......... .......... .......... .......... .......... 69% 202M 0s 2020-04-28T12:54:56.993 INFO:teuthology.orchestra.run.smithi026.stderr: 64750K .......... .......... .......... .......... .......... 69% 158M 0s 2020-04-28T12:54:56.993 INFO:teuthology.orchestra.run.smithi026.stderr: 64800K .......... .......... .......... .......... .......... 69% 120M 0s 2020-04-28T12:54:56.993 INFO:teuthology.orchestra.run.smithi026.stderr: 64850K .......... .......... .......... .......... .......... 69% 108M 0s 2020-04-28T12:54:56.994 INFO:teuthology.orchestra.run.smithi026.stderr: 64900K .......... .......... .......... .......... .......... 69% 118M 0s 2020-04-28T12:54:56.994 INFO:teuthology.orchestra.run.smithi026.stderr: 64950K .......... .......... .......... .......... .......... 69% 106M 0s 2020-04-28T12:54:56.994 INFO:teuthology.orchestra.run.smithi026.stderr: 65000K .......... .......... .......... .......... .......... 70% 119M 0s 2020-04-28T12:54:56.994 INFO:teuthology.orchestra.run.smithi026.stderr: 65050K .......... .......... .......... .......... .......... 70% 118M 0s 2020-04-28T12:54:56.994 INFO:teuthology.orchestra.run.smithi026.stderr: 65100K .......... .......... .......... .......... .......... 70% 116M 0s 2020-04-28T12:54:56.994 INFO:teuthology.orchestra.run.smithi026.stderr: 65150K .......... .......... .......... .......... .......... 70% 90.0M 0s 2020-04-28T12:54:56.995 INFO:teuthology.orchestra.run.smithi026.stderr: 65200K .......... .......... .......... .......... .......... 70% 114M 0s 2020-04-28T12:54:56.995 INFO:teuthology.orchestra.run.smithi026.stderr: 65250K .......... .......... .......... .......... .......... 70% 114M 0s 2020-04-28T12:54:56.995 INFO:teuthology.orchestra.run.smithi026.stderr: 65300K .......... .......... .......... .......... .......... 70% 123M 0s 2020-04-28T12:54:56.995 INFO:teuthology.orchestra.run.smithi026.stderr: 65350K .......... .......... .......... .......... .......... 70% 107M 0s 2020-04-28T12:54:56.995 INFO:teuthology.orchestra.run.smithi026.stderr: 65400K .......... .......... .......... .......... .......... 70% 117M 0s 2020-04-28T12:54:56.995 INFO:teuthology.orchestra.run.smithi026.stderr: 65450K .......... .......... .......... .......... .......... 70% 112M 0s 2020-04-28T12:54:56.995 INFO:teuthology.orchestra.run.smithi026.stderr: 65500K .......... .......... .......... .......... .......... 70% 100M 0s 2020-04-28T12:54:56.996 INFO:teuthology.orchestra.run.smithi026.stderr: 65550K .......... .......... .......... .......... .......... 70% 101M 0s 2020-04-28T12:54:56.996 INFO:teuthology.orchestra.run.smithi026.stderr: 65600K .......... .......... .......... .......... .......... 70% 111M 0s 2020-04-28T12:54:56.996 INFO:teuthology.orchestra.run.smithi026.stderr: 65650K .......... .......... .......... .......... .......... 70% 104M 0s 2020-04-28T12:54:56.996 INFO:teuthology.orchestra.run.smithi026.stderr: 65700K .......... .......... .......... .......... .......... 70% 119M 0s 2020-04-28T12:54:56.996 INFO:teuthology.orchestra.run.smithi026.stderr: 65750K .......... .......... .......... .......... .......... 70% 113M 0s 2020-04-28T12:54:56.996 INFO:teuthology.orchestra.run.smithi026.stderr: 65800K .......... .......... .......... .......... .......... 70% 119M 0s 2020-04-28T12:54:56.996 INFO:teuthology.orchestra.run.smithi026.stderr: 65850K .......... .......... .......... .......... .......... 70% 59.0M 0s 2020-04-28T12:54:56.997 INFO:teuthology.orchestra.run.smithi026.stderr: 65900K .......... .......... .......... .......... .......... 70% 120M 0s 2020-04-28T12:54:56.997 INFO:teuthology.orchestra.run.smithi026.stderr: 65950K .......... .......... .......... .......... .......... 71% 44.1M 0s 2020-04-28T12:54:56.997 INFO:teuthology.orchestra.run.smithi026.stderr: 66000K .......... .......... .......... .......... .......... 71% 113M 0s 2020-04-28T12:54:56.997 INFO:teuthology.orchestra.run.smithi026.stderr: 66050K .......... .......... .......... .......... .......... 71% 121M 0s 2020-04-28T12:54:56.997 INFO:teuthology.orchestra.run.smithi026.stderr: 66100K .......... .......... .......... .......... .......... 71% 95.3M 0s 2020-04-28T12:54:56.997 INFO:teuthology.orchestra.run.smithi026.stderr: 66150K .......... .......... .......... .......... .......... 71% 107M 0s 2020-04-28T12:54:56.998 INFO:teuthology.orchestra.run.smithi026.stderr: 66200K .......... .......... .......... .......... .......... 71% 95.8M 0s 2020-04-28T12:54:56.998 INFO:teuthology.orchestra.run.smithi026.stderr: 66250K .......... .......... .......... .......... .......... 71% 128M 0s 2020-04-28T12:54:56.998 INFO:teuthology.orchestra.run.smithi026.stderr: 66300K .......... .......... .......... .......... .......... 71% 126M 0s 2020-04-28T12:54:56.998 INFO:teuthology.orchestra.run.smithi026.stderr: 66350K .......... .......... .......... .......... .......... 71% 86.8M 0s 2020-04-28T12:54:56.998 INFO:teuthology.orchestra.run.smithi026.stderr: 66400K .......... .......... .......... .......... .......... 71% 114M 0s 2020-04-28T12:54:56.998 INFO:teuthology.orchestra.run.smithi026.stderr: 66450K .......... .......... .......... .......... .......... 71% 107M 0s 2020-04-28T12:54:56.998 INFO:teuthology.orchestra.run.smithi026.stderr: 66500K .......... .......... .......... .......... .......... 71% 126M 0s 2020-04-28T12:54:56.999 INFO:teuthology.orchestra.run.smithi026.stderr: 66550K .......... .......... .......... .......... .......... 71% 91.4M 0s 2020-04-28T12:54:56.999 INFO:teuthology.orchestra.run.smithi026.stderr: 66600K .......... .......... .......... .......... .......... 71% 126M 0s 2020-04-28T12:54:56.999 INFO:teuthology.orchestra.run.smithi026.stderr: 66650K .......... .......... .......... .......... .......... 71% 95.0M 0s 2020-04-28T12:54:56.999 INFO:teuthology.orchestra.run.smithi026.stderr: 66700K .......... .......... .......... .......... .......... 71% 126M 0s 2020-04-28T12:54:56.999 INFO:teuthology.orchestra.run.smithi026.stderr: 66750K .......... .......... .......... .......... .......... 71% 97.3M 0s 2020-04-28T12:54:56.999 INFO:teuthology.orchestra.run.smithi026.stderr: 66800K .......... .......... .......... .......... .......... 71% 95.0M 0s 2020-04-28T12:54:57.000 INFO:teuthology.orchestra.run.smithi026.stderr: 66850K .......... .......... .......... .......... .......... 72% 120M 0s 2020-04-28T12:54:57.000 INFO:teuthology.orchestra.run.smithi026.stderr: 66900K .......... .......... .......... .......... .......... 72% 101M 0s 2020-04-28T12:54:57.000 INFO:teuthology.orchestra.run.smithi026.stderr: 66950K .......... .......... .......... .......... .......... 72% 61.0M 0s 2020-04-28T12:54:57.000 INFO:teuthology.orchestra.run.smithi026.stderr: 67000K .......... .......... .......... .......... .......... 72% 125M 0s 2020-04-28T12:54:57.000 INFO:teuthology.orchestra.run.smithi026.stderr: 67050K .......... .......... .......... .......... .......... 72% 109M 0s 2020-04-28T12:54:57.000 INFO:teuthology.orchestra.run.smithi026.stderr: 67100K .......... .......... .......... .......... .......... 72% 84.0M 0s 2020-04-28T12:54:57.000 INFO:teuthology.orchestra.run.smithi026.stderr: 67150K .......... .......... .......... .......... .......... 72% 92.6M 0s 2020-04-28T12:54:57.001 INFO:teuthology.orchestra.run.smithi026.stderr: 67200K .......... .......... .......... .......... .......... 72% 114M 0s 2020-04-28T12:54:57.001 INFO:teuthology.orchestra.run.smithi026.stderr: 67250K .......... .......... .......... .......... .......... 72% 119M 0s 2020-04-28T12:54:57.001 INFO:teuthology.orchestra.run.smithi026.stderr: 67300K .......... .......... .......... .......... .......... 72% 115M 0s 2020-04-28T12:54:57.001 INFO:teuthology.orchestra.run.smithi026.stderr: 67350K .......... .......... .......... .......... .......... 72% 109M 0s 2020-04-28T12:54:57.001 INFO:teuthology.orchestra.run.smithi026.stderr: 67400K .......... .......... .......... .......... .......... 72% 106M 0s 2020-04-28T12:54:57.001 INFO:teuthology.orchestra.run.smithi026.stderr: 67450K .......... .......... .......... .......... .......... 72% 121M 0s 2020-04-28T12:54:57.002 INFO:teuthology.orchestra.run.smithi026.stderr: 67500K .......... .......... .......... .......... .......... 72% 106M 0s 2020-04-28T12:54:57.002 INFO:teuthology.orchestra.run.smithi026.stderr: 67550K .......... .......... .......... .......... .......... 72% 95.8M 0s 2020-04-28T12:54:57.002 INFO:teuthology.orchestra.run.smithi026.stderr: 67600K .......... .......... .......... .......... .......... 72% 116M 0s 2020-04-28T12:54:57.002 INFO:teuthology.orchestra.run.smithi026.stderr: 67650K .......... .......... .......... .......... .......... 72% 115M 0s 2020-04-28T12:54:57.002 INFO:teuthology.orchestra.run.smithi026.stderr: 67700K .......... .......... .......... .......... .......... 72% 110M 0s 2020-04-28T12:54:57.002 INFO:teuthology.orchestra.run.smithi026.stderr: 67750K .......... .......... .......... .......... .......... 72% 110M 0s 2020-04-28T12:54:57.002 INFO:teuthology.orchestra.run.smithi026.stderr: 67800K .......... .......... .......... .......... .......... 73% 121M 0s 2020-04-28T12:54:57.003 INFO:teuthology.orchestra.run.smithi026.stderr: 67850K .......... .......... .......... .......... .......... 73% 110M 0s 2020-04-28T12:54:57.003 INFO:teuthology.orchestra.run.smithi026.stderr: 67900K .......... .......... .......... .......... .......... 73% 86.8M 0s 2020-04-28T12:54:57.003 INFO:teuthology.orchestra.run.smithi026.stderr: 67950K .......... .......... .......... .......... .......... 73% 93.1M 0s 2020-04-28T12:54:57.003 INFO:teuthology.orchestra.run.smithi026.stderr: 68000K .......... .......... .......... .......... .......... 73% 105M 0s 2020-04-28T12:54:57.003 INFO:teuthology.orchestra.run.smithi026.stderr: 68050K .......... .......... .......... .......... .......... 73% 134M 0s 2020-04-28T12:54:57.004 INFO:teuthology.orchestra.run.smithi026.stderr: 68100K .......... .......... .......... .......... .......... 73% 114M 0s 2020-04-28T12:54:57.004 INFO:teuthology.orchestra.run.smithi026.stderr: 68150K .......... .......... .......... .......... .......... 73% 60.5M 0s 2020-04-28T12:54:57.004 INFO:teuthology.orchestra.run.smithi026.stderr: 68200K .......... .......... .......... .......... .......... 73% 120M 0s 2020-04-28T12:54:57.004 INFO:teuthology.orchestra.run.smithi026.stderr: 68250K .......... .......... .......... .......... .......... 73% 70.5M 0s 2020-04-28T12:54:57.004 INFO:teuthology.orchestra.run.smithi026.stderr: 68300K .......... .......... .......... .......... .......... 73% 51.8M 0s 2020-04-28T12:54:57.004 INFO:teuthology.orchestra.run.smithi026.stderr: 68350K .......... .......... .......... .......... .......... 73% 79.3M 0s 2020-04-28T12:54:57.004 INFO:teuthology.orchestra.run.smithi026.stderr: 68400K .......... .......... .......... .......... .......... 73% 62.9M 0s 2020-04-28T12:54:57.005 INFO:teuthology.orchestra.run.smithi026.stderr: 68450K .......... .......... .......... .......... .......... 73% 110M 0s 2020-04-28T12:54:57.005 INFO:teuthology.orchestra.run.smithi026.stderr: 68500K .......... .......... .......... .......... .......... 73% 126M 0s 2020-04-28T12:54:57.005 INFO:teuthology.orchestra.run.smithi026.stderr: 68550K .......... .......... .......... .......... .......... 73% 49.4M 0s 2020-04-28T12:54:57.005 INFO:teuthology.orchestra.run.smithi026.stderr: 68600K .......... .......... .......... .......... .......... 73% 117M 0s 2020-04-28T12:54:57.005 INFO:teuthology.orchestra.run.smithi026.stderr: 68650K .......... .......... .......... .......... .......... 73% 76.6M 0s 2020-04-28T12:54:57.005 INFO:teuthology.orchestra.run.smithi026.stderr: 68700K .......... .......... .......... .......... .......... 74% 108M 0s 2020-04-28T12:54:57.006 INFO:teuthology.orchestra.run.smithi026.stderr: 68750K .......... .......... .......... .......... .......... 74% 58.4M 0s 2020-04-28T12:54:57.006 INFO:teuthology.orchestra.run.smithi026.stderr: 68800K .......... .......... .......... .......... .......... 74% 75.4M 0s 2020-04-28T12:54:57.006 INFO:teuthology.orchestra.run.smithi026.stderr: 68850K .......... .......... .......... .......... .......... 74% 65.2M 0s 2020-04-28T12:54:57.006 INFO:teuthology.orchestra.run.smithi026.stderr: 68900K .......... .......... .......... .......... .......... 74% 75.9M 0s 2020-04-28T12:54:57.006 INFO:teuthology.orchestra.run.smithi026.stderr: 68950K .......... .......... .......... .......... .......... 74% 116M 0s 2020-04-28T12:54:57.006 INFO:teuthology.orchestra.run.smithi026.stderr: 69000K .......... .......... .......... .......... .......... 74% 65.0M 0s 2020-04-28T12:54:57.006 INFO:teuthology.orchestra.run.smithi026.stderr: 69050K .......... .......... .......... .......... .......... 74% 116M 0s 2020-04-28T12:54:57.007 INFO:teuthology.orchestra.run.smithi026.stderr: 69100K .......... .......... .......... .......... .......... 74% 55.5M 0s 2020-04-28T12:54:57.007 INFO:teuthology.orchestra.run.smithi026.stderr: 69150K .......... .......... .......... .......... .......... 74% 75.3M 0s 2020-04-28T12:54:57.007 INFO:teuthology.orchestra.run.smithi026.stderr: 69200K .......... .......... .......... .......... .......... 74% 118M 0s 2020-04-28T12:54:57.007 INFO:teuthology.orchestra.run.smithi026.stderr: 69250K .......... .......... .......... .......... .......... 74% 76.2M 0s 2020-04-28T12:54:57.007 INFO:teuthology.orchestra.run.smithi026.stderr: 69300K .......... .......... .......... .......... .......... 74% 64.6M 0s 2020-04-28T12:54:57.007 INFO:teuthology.orchestra.run.smithi026.stderr: 69350K .......... .......... .......... .......... .......... 74% 109M 0s 2020-04-28T12:54:57.008 INFO:teuthology.orchestra.run.smithi026.stderr: 69400K .......... .......... .......... .......... .......... 74% 78.2M 0s 2020-04-28T12:54:57.008 INFO:teuthology.orchestra.run.smithi026.stderr: 69450K .......... .......... .......... .......... .......... 74% 117M 0s 2020-04-28T12:54:57.008 INFO:teuthology.orchestra.run.smithi026.stderr: 69500K .......... .......... .......... .......... .......... 74% 62.9M 0s 2020-04-28T12:54:57.008 INFO:teuthology.orchestra.run.smithi026.stderr: 69550K .......... .......... .......... .......... .......... 74% 67.8M 0s 2020-04-28T12:54:57.008 INFO:teuthology.orchestra.run.smithi026.stderr: 69600K .......... .......... .......... .......... .......... 74% 64.9M 0s 2020-04-28T12:54:57.008 INFO:teuthology.orchestra.run.smithi026.stderr: 69650K .......... .......... .......... .......... .......... 75% 111M 0s 2020-04-28T12:54:57.009 INFO:teuthology.orchestra.run.smithi026.stderr: 69700K .......... .......... .......... .......... .......... 75% 110M 0s 2020-04-28T12:54:57.009 INFO:teuthology.orchestra.run.smithi026.stderr: 69750K .......... .......... .......... .......... .......... 75% 79.8M 0s 2020-04-28T12:54:57.009 INFO:teuthology.orchestra.run.smithi026.stderr: 69800K .......... .......... .......... .......... .......... 75% 64.7M 0s 2020-04-28T12:54:57.009 INFO:teuthology.orchestra.run.smithi026.stderr: 69850K .......... .......... .......... .......... .......... 75% 115M 0s 2020-04-28T12:54:57.009 INFO:teuthology.orchestra.run.smithi026.stderr: 69900K .......... .......... .......... .......... .......... 75% 111M 0s 2020-04-28T12:54:57.009 INFO:teuthology.orchestra.run.smithi026.stderr: 69950K .......... .......... .......... .......... .......... 75% 66.8M 0s 2020-04-28T12:54:57.010 INFO:teuthology.orchestra.run.smithi026.stderr: 70000K .......... .......... .......... .......... .......... 75% 65.1M 0s 2020-04-28T12:54:57.010 INFO:teuthology.orchestra.run.smithi026.stderr: 70050K .......... .......... .......... .......... .......... 75% 118M 0s 2020-04-28T12:54:57.010 INFO:teuthology.orchestra.run.smithi026.stderr: 70100K .......... .......... .......... .......... .......... 75% 76.6M 0s 2020-04-28T12:54:57.010 INFO:teuthology.orchestra.run.smithi026.stderr: 70150K .......... .......... .......... .......... .......... 75% 64.4M 0s 2020-04-28T12:54:57.010 INFO:teuthology.orchestra.run.smithi026.stderr: 70200K .......... .......... .......... .......... .......... 75% 110M 0s 2020-04-28T12:54:57.010 INFO:teuthology.orchestra.run.smithi026.stderr: 70250K .......... .......... .......... .......... .......... 75% 115M 0s 2020-04-28T12:54:57.011 INFO:teuthology.orchestra.run.smithi026.stderr: 70300K .......... .......... .......... .......... .......... 75% 77.8M 0s 2020-04-28T12:54:57.011 INFO:teuthology.orchestra.run.smithi026.stderr: 70350K .......... .......... .......... .......... .......... 75% 57.4M 0s 2020-04-28T12:54:57.011 INFO:teuthology.orchestra.run.smithi026.stderr: 70400K .......... .......... .......... .......... .......... 75% 75.4M 0s 2020-04-28T12:54:57.011 INFO:teuthology.orchestra.run.smithi026.stderr: 70450K .......... .......... .......... .......... .......... 75% 114M 0s 2020-04-28T12:54:57.011 INFO:teuthology.orchestra.run.smithi026.stderr: 70500K .......... .......... .......... .......... .......... 75% 110M 0s 2020-04-28T12:54:57.011 INFO:teuthology.orchestra.run.smithi026.stderr: 70550K .......... .......... .......... .......... .......... 75% 66.3M 0s 2020-04-28T12:54:57.011 INFO:teuthology.orchestra.run.smithi026.stderr: 70600K .......... .......... .......... .......... .......... 76% 78.5M 0s 2020-04-28T12:54:57.012 INFO:teuthology.orchestra.run.smithi026.stderr: 70650K .......... .......... .......... .......... .......... 76% 108M 0s 2020-04-28T12:54:57.012 INFO:teuthology.orchestra.run.smithi026.stderr: 70700K .......... .......... .......... .......... .......... 76% 69.0M 0s 2020-04-28T12:54:57.012 INFO:teuthology.orchestra.run.smithi026.stderr: 70750K .......... .......... .......... .......... .......... 76% 90.0M 0s 2020-04-28T12:54:57.012 INFO:teuthology.orchestra.run.smithi026.stderr: 70800K .......... .......... .......... .......... .......... 76% 77.7M 0s 2020-04-28T12:54:57.012 INFO:teuthology.orchestra.run.smithi026.stderr: 70850K .......... .......... .......... .......... .......... 76% 50.8M 0s 2020-04-28T12:54:57.012 INFO:teuthology.orchestra.run.smithi026.stderr: 70900K .......... .......... .......... .......... .......... 76% 105M 0s 2020-04-28T12:54:57.012 INFO:teuthology.orchestra.run.smithi026.stderr: 70950K .......... .......... .......... .......... .......... 76% 126M 0s 2020-04-28T12:54:57.013 INFO:teuthology.orchestra.run.smithi026.stderr: 71000K .......... .......... .......... .......... .......... 76% 42.3M 0s 2020-04-28T12:54:57.013 INFO:teuthology.orchestra.run.smithi026.stderr: 71050K .......... .......... .......... .......... .......... 76% 202M 0s 2020-04-28T12:54:57.013 INFO:teuthology.orchestra.run.smithi026.stderr: 71100K .......... .......... .......... .......... .......... 76% 84.4M 0s 2020-04-28T12:54:57.013 INFO:teuthology.orchestra.run.smithi026.stderr: 71150K .......... .......... .......... .......... .......... 76% 55.3M 0s 2020-04-28T12:54:57.013 INFO:teuthology.orchestra.run.smithi026.stderr: 71200K .......... .......... .......... .......... .......... 76% 118M 0s 2020-04-28T12:54:57.013 INFO:teuthology.orchestra.run.smithi026.stderr: 71250K .......... .......... .......... .......... .......... 76% 50.5M 0s 2020-04-28T12:54:57.014 INFO:teuthology.orchestra.run.smithi026.stderr: 71300K .......... .......... .......... .......... .......... 76% 85.1M 0s 2020-04-28T12:54:57.014 INFO:teuthology.orchestra.run.smithi026.stderr: 71350K .......... .......... .......... .......... .......... 76% 57.7M 0s 2020-04-28T12:54:57.014 INFO:teuthology.orchestra.run.smithi026.stderr: 71400K .......... .......... .......... .......... .......... 76% 116M 0s 2020-04-28T12:54:57.014 INFO:teuthology.orchestra.run.smithi026.stderr: 71450K .......... .......... .......... .......... .......... 76% 50.1M 0s 2020-04-28T12:54:57.014 INFO:teuthology.orchestra.run.smithi026.stderr: 71500K .......... .......... .......... .......... .......... 77% 49.8M 0s 2020-04-28T12:54:57.014 INFO:teuthology.orchestra.run.smithi026.stderr: 71550K .......... .......... .......... .......... .......... 77% 62.5M 0s 2020-04-28T12:54:57.014 INFO:teuthology.orchestra.run.smithi026.stderr: 71600K .......... .......... .......... .......... .......... 77% 67.6M 0s 2020-04-28T12:54:57.015 INFO:teuthology.orchestra.run.smithi026.stderr: 71650K .......... .......... .......... .......... .......... 77% 122M 0s 2020-04-28T12:54:57.015 INFO:teuthology.orchestra.run.smithi026.stderr: 71700K .......... .......... .......... .......... .......... 77% 50.5M 0s 2020-04-28T12:54:57.015 INFO:teuthology.orchestra.run.smithi026.stderr: 71750K .......... .......... .......... .......... .......... 77% 49.1M 0s 2020-04-28T12:54:57.015 INFO:teuthology.orchestra.run.smithi026.stderr: 71800K .......... .......... .......... .......... .......... 77% 80.2M 0s 2020-04-28T12:54:57.015 INFO:teuthology.orchestra.run.smithi026.stderr: 71850K .......... .......... .......... .......... .......... 77% 62.3M 0s 2020-04-28T12:54:57.015 INFO:teuthology.orchestra.run.smithi026.stderr: 71900K .......... .......... .......... .......... .......... 77% 122M 0s 2020-04-28T12:54:57.016 INFO:teuthology.orchestra.run.smithi026.stderr: 71950K .......... .......... .......... .......... .......... 77% 69.2M 0s 2020-04-28T12:54:57.016 INFO:teuthology.orchestra.run.smithi026.stderr: 72000K .......... .......... .......... .......... .......... 77% 74.0M 0s 2020-04-28T12:54:57.016 INFO:teuthology.orchestra.run.smithi026.stderr: 72050K .......... .......... .......... .......... .......... 77% 74.5M 0s 2020-04-28T12:54:57.016 INFO:teuthology.orchestra.run.smithi026.stderr: 72100K .......... .......... .......... .......... .......... 77% 60.5M 0s 2020-04-28T12:54:57.016 INFO:teuthology.orchestra.run.smithi026.stderr: 72150K .......... .......... .......... .......... .......... 77% 115M 0s 2020-04-28T12:54:57.016 INFO:teuthology.orchestra.run.smithi026.stderr: 72200K .......... .......... .......... .......... .......... 77% 75.3M 0s 2020-04-28T12:54:57.016 INFO:teuthology.orchestra.run.smithi026.stderr: 72250K .......... .......... .......... .......... .......... 77% 96.6M 0s 2020-04-28T12:54:57.017 INFO:teuthology.orchestra.run.smithi026.stderr: 72300K .......... .......... .......... .......... .......... 77% 76.5M 0s 2020-04-28T12:54:57.017 INFO:teuthology.orchestra.run.smithi026.stderr: 72350K .......... .......... .......... .......... .......... 77% 60.9M 0s 2020-04-28T12:54:57.017 INFO:teuthology.orchestra.run.smithi026.stderr: 72400K .......... .......... .......... .......... .......... 77% 117M 0s 2020-04-28T12:54:57.017 INFO:teuthology.orchestra.run.smithi026.stderr: 72450K .......... .......... .......... .......... .......... 78% 62.5M 0s 2020-04-28T12:54:57.017 INFO:teuthology.orchestra.run.smithi026.stderr: 72500K .......... .......... .......... .......... .......... 78% 68.1M 0s 2020-04-28T12:54:57.018 INFO:teuthology.orchestra.run.smithi026.stderr: 72550K .......... .......... .......... .......... .......... 78% 106M 0s 2020-04-28T12:54:57.018 INFO:teuthology.orchestra.run.smithi026.stderr: 72600K .......... .......... .......... .......... .......... 78% 53.1M 0s 2020-04-28T12:54:57.018 INFO:teuthology.orchestra.run.smithi026.stderr: 72650K .......... .......... .......... .......... .......... 78% 175M 0s 2020-04-28T12:54:57.018 INFO:teuthology.orchestra.run.smithi026.stderr: 72700K .......... .......... .......... .......... .......... 78% 79.7M 0s 2020-04-28T12:54:57.018 INFO:teuthology.orchestra.run.smithi026.stderr: 72750K .......... .......... .......... .......... .......... 78% 85.2M 0s 2020-04-28T12:54:57.018 INFO:teuthology.orchestra.run.smithi026.stderr: 72800K .......... .......... .......... .......... .......... 78% 65.9M 0s 2020-04-28T12:54:57.019 INFO:teuthology.orchestra.run.smithi026.stderr: 72850K .......... .......... .......... .......... .......... 78% 117M 0s 2020-04-28T12:54:57.019 INFO:teuthology.orchestra.run.smithi026.stderr: 72900K .......... .......... .......... .......... .......... 78% 124M 0s 2020-04-28T12:54:57.019 INFO:teuthology.orchestra.run.smithi026.stderr: 72950K .......... .......... .......... .......... .......... 78% 73.7M 0s 2020-04-28T12:54:57.019 INFO:teuthology.orchestra.run.smithi026.stderr: 73000K .......... .......... .......... .......... .......... 78% 91.8M 0s 2020-04-28T12:54:57.019 INFO:teuthology.orchestra.run.smithi026.stderr: 73050K .......... .......... .......... .......... .......... 78% 75.5M 0s 2020-04-28T12:54:57.019 INFO:teuthology.orchestra.run.smithi026.stderr: 73100K .......... .......... .......... .......... .......... 78% 118M 0s 2020-04-28T12:54:57.020 INFO:teuthology.orchestra.run.smithi026.stderr: 73150K .......... .......... .......... .......... .......... 78% 63.7M 0s 2020-04-28T12:54:57.020 INFO:teuthology.orchestra.run.smithi026.stderr: 73200K .......... .......... .......... .......... .......... 78% 90.6M 0s 2020-04-28T12:54:57.020 INFO:teuthology.orchestra.run.smithi026.stderr: 73250K .......... .......... .......... .......... .......... 78% 73.8M 0s 2020-04-28T12:54:57.020 INFO:teuthology.orchestra.run.smithi026.stderr: 73300K .......... .......... .......... .......... .......... 78% 72.5M 0s 2020-04-28T12:54:57.020 INFO:teuthology.orchestra.run.smithi026.stderr: 73350K .......... .......... .......... .......... .......... 79% 124M 0s 2020-04-28T12:54:57.020 INFO:teuthology.orchestra.run.smithi026.stderr: 73400K .......... .......... .......... .......... .......... 79% 100M 0s 2020-04-28T12:54:57.020 INFO:teuthology.orchestra.run.smithi026.stderr: 73450K .......... .......... .......... .......... .......... 79% 65.4M 0s 2020-04-28T12:54:57.021 INFO:teuthology.orchestra.run.smithi026.stderr: 73500K .......... .......... .......... .......... .......... 79% 88.1M 0s 2020-04-28T12:54:57.021 INFO:teuthology.orchestra.run.smithi026.stderr: 73550K .......... .......... .......... .......... .......... 79% 69.0M 0s 2020-04-28T12:54:57.021 INFO:teuthology.orchestra.run.smithi026.stderr: 73600K .......... .......... .......... .......... .......... 79% 66.9M 0s 2020-04-28T12:54:57.021 INFO:teuthology.orchestra.run.smithi026.stderr: 73650K .......... .......... .......... .......... .......... 79% 123M 0s 2020-04-28T12:54:57.021 INFO:teuthology.orchestra.run.smithi026.stderr: 73700K .......... .......... .......... .......... .......... 79% 73.7M 0s 2020-04-28T12:54:57.021 INFO:teuthology.orchestra.run.smithi026.stderr: 73750K .......... .......... .......... .......... .......... 79% 67.0M 0s 2020-04-28T12:54:57.022 INFO:teuthology.orchestra.run.smithi026.stderr: 73800K .......... .......... .......... .......... .......... 79% 70.8M 0s 2020-04-28T12:54:57.022 INFO:teuthology.orchestra.run.smithi026.stderr: 73850K .......... .......... .......... .......... .......... 79% 117M 0s 2020-04-28T12:54:57.022 INFO:teuthology.orchestra.run.smithi026.stderr: 73900K .......... .......... .......... .......... .......... 79% 108M 0s 2020-04-28T12:54:57.022 INFO:teuthology.orchestra.run.smithi026.stderr: 73950K .......... .......... .......... .......... .......... 79% 58.8M 0s 2020-04-28T12:54:57.022 INFO:teuthology.orchestra.run.smithi026.stderr: 74000K .......... .......... .......... .......... .......... 79% 74.0M 0s 2020-04-28T12:54:57.022 INFO:teuthology.orchestra.run.smithi026.stderr: 74050K .......... .......... .......... .......... .......... 79% 68.7M 0s 2020-04-28T12:54:57.023 INFO:teuthology.orchestra.run.smithi026.stderr: 74100K .......... .......... .......... .......... .......... 79% 116M 0s 2020-04-28T12:54:57.023 INFO:teuthology.orchestra.run.smithi026.stderr: 74150K .......... .......... .......... .......... .......... 79% 71.4M 0s 2020-04-28T12:54:57.023 INFO:teuthology.orchestra.run.smithi026.stderr: 74200K .......... .......... .......... .......... .......... 79% 67.3M 0s 2020-04-28T12:54:57.023 INFO:teuthology.orchestra.run.smithi026.stderr: 74250K .......... .......... .......... .......... .......... 79% 114M 0s 2020-04-28T12:54:57.023 INFO:teuthology.orchestra.run.smithi026.stderr: 74300K .......... .......... .......... .......... .......... 80% 70.6M 0s 2020-04-28T12:54:57.023 INFO:teuthology.orchestra.run.smithi026.stderr: 74350K .......... .......... .......... .......... .......... 80% 58.3M 0s 2020-04-28T12:54:57.023 INFO:teuthology.orchestra.run.smithi026.stderr: 74400K .......... .......... .......... .......... .......... 80% 124M 0s 2020-04-28T12:54:57.024 INFO:teuthology.orchestra.run.smithi026.stderr: 74450K .......... .......... .......... .......... .......... 80% 73.8M 0s 2020-04-28T12:54:57.024 INFO:teuthology.orchestra.run.smithi026.stderr: 74500K .......... .......... .......... .......... .......... 80% 67.6M 0s 2020-04-28T12:54:57.024 INFO:teuthology.orchestra.run.smithi026.stderr: 74550K .......... .......... .......... .......... .......... 80% 113M 0s 2020-04-28T12:54:57.024 INFO:teuthology.orchestra.run.smithi026.stderr: 74600K .......... .......... .......... .......... .......... 80% 120M 0s 2020-04-28T12:54:57.024 INFO:teuthology.orchestra.run.smithi026.stderr: 74650K .......... .......... .......... .......... .......... 80% 71.4M 0s 2020-04-28T12:54:57.025 INFO:teuthology.orchestra.run.smithi026.stderr: 74700K .......... .......... .......... .......... .......... 80% 67.2M 0s 2020-04-28T12:54:57.025 INFO:teuthology.orchestra.run.smithi026.stderr: 74750K .......... .......... .......... .......... .......... 80% 61.7M 0s 2020-04-28T12:54:57.025 INFO:teuthology.orchestra.run.smithi026.stderr: 74800K .......... .......... .......... .......... .......... 80% 68.7M 0s 2020-04-28T12:54:57.025 INFO:teuthology.orchestra.run.smithi026.stderr: 74850K .......... .......... .......... .......... .......... 80% 120M 0s 2020-04-28T12:54:57.025 INFO:teuthology.orchestra.run.smithi026.stderr: 74900K .......... .......... .......... .......... .......... 80% 101M 0s 2020-04-28T12:54:57.026 INFO:teuthology.orchestra.run.smithi026.stderr: 74950K .......... .......... .......... .......... .......... 80% 74.9M 0s 2020-04-28T12:54:57.026 INFO:teuthology.orchestra.run.smithi026.stderr: 75000K .......... .......... .......... .......... .......... 80% 68.9M 0s 2020-04-28T12:54:57.026 INFO:teuthology.orchestra.run.smithi026.stderr: 75050K .......... .......... .......... .......... .......... 80% 117M 0s 2020-04-28T12:54:57.026 INFO:teuthology.orchestra.run.smithi026.stderr: 75100K .......... .......... .......... .......... .......... 80% 71.3M 0s 2020-04-28T12:54:57.026 INFO:teuthology.orchestra.run.smithi026.stderr: 75150K .......... .......... .......... .......... .......... 80% 58.2M 0s 2020-04-28T12:54:57.026 INFO:teuthology.orchestra.run.smithi026.stderr: 75200K .......... .......... .......... .......... .......... 81% 101M 0s 2020-04-28T12:54:57.027 INFO:teuthology.orchestra.run.smithi026.stderr: 75250K .......... .......... .......... .......... .......... 81% 80.7M 0s 2020-04-28T12:54:57.027 INFO:teuthology.orchestra.run.smithi026.stderr: 75300K .......... .......... .......... .......... .......... 81% 66.7M 0s 2020-04-28T12:54:57.027 INFO:teuthology.orchestra.run.smithi026.stderr: 75350K .......... .......... .......... .......... .......... 81% 115M 0s 2020-04-28T12:54:57.027 INFO:teuthology.orchestra.run.smithi026.stderr: 75400K .......... .......... .......... .......... .......... 81% 74.6M 0s 2020-04-28T12:54:57.027 INFO:teuthology.orchestra.run.smithi026.stderr: 75450K .......... .......... .......... .......... .......... 81% 65.3M 0s 2020-04-28T12:54:57.027 INFO:teuthology.orchestra.run.smithi026.stderr: 75500K .......... .......... .......... .......... .......... 81% 105M 0s 2020-04-28T12:54:57.028 INFO:teuthology.orchestra.run.smithi026.stderr: 75550K .......... .......... .......... .......... .......... 81% 66.4M 0s 2020-04-28T12:54:57.028 INFO:teuthology.orchestra.run.smithi026.stderr: 75600K .......... .......... .......... .......... .......... 81% 116M 0s 2020-04-28T12:54:57.028 INFO:teuthology.orchestra.run.smithi026.stderr: 75650K .......... .......... .......... .......... .......... 81% 54.9M 0s 2020-04-28T12:54:57.028 INFO:teuthology.orchestra.run.smithi026.stderr: 75700K .......... .......... .......... .......... .......... 81% 98.3M 0s 2020-04-28T12:54:57.028 INFO:teuthology.orchestra.run.smithi026.stderr: 75750K .......... .......... .......... .......... .......... 81% 64.3M 0s 2020-04-28T12:54:57.028 INFO:teuthology.orchestra.run.smithi026.stderr: 75800K .......... .......... .......... .......... .......... 81% 125M 0s 2020-04-28T12:54:57.028 INFO:teuthology.orchestra.run.smithi026.stderr: 75850K .......... .......... .......... .......... .......... 81% 72.7M 0s 2020-04-28T12:54:57.029 INFO:teuthology.orchestra.run.smithi026.stderr: 75900K .......... .......... .......... .......... .......... 81% 65.0M 0s 2020-04-28T12:54:57.029 INFO:teuthology.orchestra.run.smithi026.stderr: 75950K .......... .......... .......... .......... .......... 81% 85.7M 0s 2020-04-28T12:54:57.029 INFO:teuthology.orchestra.run.smithi026.stderr: 76000K .......... .......... .......... .......... .......... 81% 73.9M 0s 2020-04-28T12:54:57.029 INFO:teuthology.orchestra.run.smithi026.stderr: 76050K .......... .......... .......... .......... .......... 81% 65.8M 0s 2020-04-28T12:54:57.029 INFO:teuthology.orchestra.run.smithi026.stderr: 76100K .......... .......... .......... .......... .......... 81% 63.2M 0s 2020-04-28T12:54:57.029 INFO:teuthology.orchestra.run.smithi026.stderr: 76150K .......... .......... .......... .......... .......... 82% 140M 0s 2020-04-28T12:54:57.029 INFO:teuthology.orchestra.run.smithi026.stderr: 76200K .......... .......... .......... .......... .......... 82% 73.9M 0s 2020-04-28T12:54:57.030 INFO:teuthology.orchestra.run.smithi026.stderr: 76250K .......... .......... .......... .......... .......... 82% 120M 0s 2020-04-28T12:54:57.030 INFO:teuthology.orchestra.run.smithi026.stderr: 76300K .......... .......... .......... .......... .......... 82% 120M 0s 2020-04-28T12:54:57.030 INFO:teuthology.orchestra.run.smithi026.stderr: 76350K .......... .......... .......... .......... .......... 82% 86.3M 0s 2020-04-28T12:54:57.030 INFO:teuthology.orchestra.run.smithi026.stderr: 76400K .......... .......... .......... .......... .......... 82% 104M 0s 2020-04-28T12:54:57.030 INFO:teuthology.orchestra.run.smithi026.stderr: 76450K .......... .......... .......... .......... .......... 82% 112M 0s 2020-04-28T12:54:57.030 INFO:teuthology.orchestra.run.smithi026.stderr: 76500K .......... .......... .......... .......... .......... 82% 116M 0s 2020-04-28T12:54:57.031 INFO:teuthology.orchestra.run.smithi026.stderr: 76550K .......... .......... .......... .......... .......... 82% 129M 0s 2020-04-28T12:54:57.031 INFO:teuthology.orchestra.run.smithi026.stderr: 76600K .......... .......... .......... .......... .......... 82% 115M 0s 2020-04-28T12:54:57.031 INFO:teuthology.orchestra.run.smithi026.stderr: 76650K .......... .......... .......... .......... .......... 82% 109M 0s 2020-04-28T12:54:57.031 INFO:teuthology.orchestra.run.smithi026.stderr: 76700K .......... .......... .......... .......... .......... 82% 112M 0s 2020-04-28T12:54:57.031 INFO:teuthology.orchestra.run.smithi026.stderr: 76750K .......... .......... .......... .......... .......... 82% 82.6M 0s 2020-04-28T12:54:57.031 INFO:teuthology.orchestra.run.smithi026.stderr: 76800K .......... .......... .......... .......... .......... 82% 136M 0s 2020-04-28T12:54:57.032 INFO:teuthology.orchestra.run.smithi026.stderr: 76850K .......... .......... .......... .......... .......... 82% 71.4M 0s 2020-04-28T12:54:57.032 INFO:teuthology.orchestra.run.smithi026.stderr: 76900K .......... .......... .......... .......... .......... 82% 203M 0s 2020-04-28T12:54:57.032 INFO:teuthology.orchestra.run.smithi026.stderr: 76950K .......... .......... .......... .......... .......... 82% 133M 0s 2020-04-28T12:54:57.032 INFO:teuthology.orchestra.run.smithi026.stderr: 77000K .......... .......... .......... .......... .......... 82% 115M 0s 2020-04-28T12:54:57.032 INFO:teuthology.orchestra.run.smithi026.stderr: 77050K .......... .......... .......... .......... .......... 82% 119M 0s 2020-04-28T12:54:57.032 INFO:teuthology.orchestra.run.smithi026.stderr: 77100K .......... .......... .......... .......... .......... 83% 110M 0s 2020-04-28T12:54:57.033 INFO:teuthology.orchestra.run.smithi026.stderr: 77150K .......... .......... .......... .......... .......... 83% 91.6M 0s 2020-04-28T12:54:57.033 INFO:teuthology.orchestra.run.smithi026.stderr: 77200K .......... .......... .......... .......... .......... 83% 121M 0s 2020-04-28T12:54:57.033 INFO:teuthology.orchestra.run.smithi026.stderr: 77250K .......... .......... .......... .......... .......... 83% 107M 0s 2020-04-28T12:54:57.033 INFO:teuthology.orchestra.run.smithi026.stderr: 77300K .......... .......... .......... .......... .......... 83% 119M 0s 2020-04-28T12:54:57.033 INFO:teuthology.orchestra.run.smithi026.stderr: 77350K .......... .......... .......... .......... .......... 83% 110M 0s 2020-04-28T12:54:57.033 INFO:teuthology.orchestra.run.smithi026.stderr: 77400K .......... .......... .......... .......... .......... 83% 117M 0s 2020-04-28T12:54:57.033 INFO:teuthology.orchestra.run.smithi026.stderr: 77450K .......... .......... .......... .......... .......... 83% 107M 0s 2020-04-28T12:54:57.034 INFO:teuthology.orchestra.run.smithi026.stderr: 77500K .......... .......... .......... .......... .......... 83% 127M 0s 2020-04-28T12:54:57.034 INFO:teuthology.orchestra.run.smithi026.stderr: 77550K .......... .......... .......... .......... .......... 83% 90.5M 0s 2020-04-28T12:54:57.034 INFO:teuthology.orchestra.run.smithi026.stderr: 77600K .......... .......... .......... .......... .......... 83% 106M 0s 2020-04-28T12:54:57.034 INFO:teuthology.orchestra.run.smithi026.stderr: 77650K .......... .......... .......... .......... .......... 83% 126M 0s 2020-04-28T12:54:57.034 INFO:teuthology.orchestra.run.smithi026.stderr: 77700K .......... .......... .......... .......... .......... 83% 112M 0s 2020-04-28T12:54:57.035 INFO:teuthology.orchestra.run.smithi026.stderr: 77750K .......... .......... .......... .......... .......... 83% 109M 0s 2020-04-28T12:54:57.035 INFO:teuthology.orchestra.run.smithi026.stderr: 77800K .......... .......... .......... .......... .......... 83% 122M 0s 2020-04-28T12:54:57.035 INFO:teuthology.orchestra.run.smithi026.stderr: 77850K .......... .......... .......... .......... .......... 83% 111M 0s 2020-04-28T12:54:57.035 INFO:teuthology.orchestra.run.smithi026.stderr: 77900K .......... .......... .......... .......... .......... 83% 113M 0s 2020-04-28T12:54:57.035 INFO:teuthology.orchestra.run.smithi026.stderr: 77950K .......... .......... .......... .......... .......... 83% 91.3M 0s 2020-04-28T12:54:57.035 INFO:teuthology.orchestra.run.smithi026.stderr: 78000K .......... .......... .......... .......... .......... 84% 116M 0s 2020-04-28T12:54:57.035 INFO:teuthology.orchestra.run.smithi026.stderr: 78050K .......... .......... .......... .......... .......... 84% 117M 0s 2020-04-28T12:54:57.036 INFO:teuthology.orchestra.run.smithi026.stderr: 78100K .......... .......... .......... .......... .......... 84% 102M 0s 2020-04-28T12:54:57.036 INFO:teuthology.orchestra.run.smithi026.stderr: 78150K .......... .......... .......... .......... .......... 84% 122M 0s 2020-04-28T12:54:57.036 INFO:teuthology.orchestra.run.smithi026.stderr: 78200K .......... .......... .......... .......... .......... 84% 108M 0s 2020-04-28T12:54:57.036 INFO:teuthology.orchestra.run.smithi026.stderr: 78250K .......... .......... .......... .......... .......... 84% 126M 0s 2020-04-28T12:54:57.036 INFO:teuthology.orchestra.run.smithi026.stderr: 78300K .......... .......... .......... .......... .......... 84% 113M 0s 2020-04-28T12:54:57.036 INFO:teuthology.orchestra.run.smithi026.stderr: 78350K .......... .......... .......... .......... .......... 84% 86.6M 0s 2020-04-28T12:54:57.037 INFO:teuthology.orchestra.run.smithi026.stderr: 78400K .......... .......... .......... .......... .......... 84% 115M 0s 2020-04-28T12:54:57.037 INFO:teuthology.orchestra.run.smithi026.stderr: 78450K .......... .......... .......... .......... .......... 84% 122M 0s 2020-04-28T12:54:57.037 INFO:teuthology.orchestra.run.smithi026.stderr: 78500K .......... .......... .......... .......... .......... 84% 113M 0s 2020-04-28T12:54:57.037 INFO:teuthology.orchestra.run.smithi026.stderr: 78550K .......... .......... .......... .......... .......... 84% 114M 0s 2020-04-28T12:54:57.037 INFO:teuthology.orchestra.run.smithi026.stderr: 78600K .......... .......... .......... .......... .......... 84% 114M 0s 2020-04-28T12:54:57.037 INFO:teuthology.orchestra.run.smithi026.stderr: 78650K .......... .......... .......... .......... .......... 84% 113M 0s 2020-04-28T12:54:57.037 INFO:teuthology.orchestra.run.smithi026.stderr: 78700K .......... .......... .......... .......... .......... 84% 117M 0s 2020-04-28T12:54:57.038 INFO:teuthology.orchestra.run.smithi026.stderr: 78750K .......... .......... .......... .......... .......... 84% 86.1M 0s 2020-04-28T12:54:57.038 INFO:teuthology.orchestra.run.smithi026.stderr: 78800K .......... .......... .......... .......... .......... 84% 121M 0s 2020-04-28T12:54:57.038 INFO:teuthology.orchestra.run.smithi026.stderr: 78850K .......... .......... .......... .......... .......... 84% 117M 0s 2020-04-28T12:54:57.038 INFO:teuthology.orchestra.run.smithi026.stderr: 78900K .......... .......... .......... .......... .......... 84% 118M 0s 2020-04-28T12:54:57.038 INFO:teuthology.orchestra.run.smithi026.stderr: 78950K .......... .......... .......... .......... .......... 85% 111M 0s 2020-04-28T12:54:57.038 INFO:teuthology.orchestra.run.smithi026.stderr: 79000K .......... .......... .......... .......... .......... 85% 116M 0s 2020-04-28T12:54:57.038 INFO:teuthology.orchestra.run.smithi026.stderr: 79050K .......... .......... .......... .......... .......... 85% 117M 0s 2020-04-28T12:54:57.039 INFO:teuthology.orchestra.run.smithi026.stderr: 79100K .......... .......... .......... .......... .......... 85% 115M 0s 2020-04-28T12:54:57.039 INFO:teuthology.orchestra.run.smithi026.stderr: 79150K .......... .......... .......... .......... .......... 85% 88.0M 0s 2020-04-28T12:54:57.039 INFO:teuthology.orchestra.run.smithi026.stderr: 79200K .......... .......... .......... .......... .......... 85% 114M 0s 2020-04-28T12:54:57.039 INFO:teuthology.orchestra.run.smithi026.stderr: 79250K .......... .......... .......... .......... .......... 85% 106M 0s 2020-04-28T12:54:57.039 INFO:teuthology.orchestra.run.smithi026.stderr: 79300K .......... .......... .......... .......... .......... 85% 108M 0s 2020-04-28T12:54:57.039 INFO:teuthology.orchestra.run.smithi026.stderr: 79350K .......... .......... .......... .......... .......... 85% 121M 0s 2020-04-28T12:54:57.040 INFO:teuthology.orchestra.run.smithi026.stderr: 79400K .......... .......... .......... .......... .......... 85% 129M 0s 2020-04-28T12:54:57.040 INFO:teuthology.orchestra.run.smithi026.stderr: 79450K .......... .......... .......... .......... .......... 85% 118M 0s 2020-04-28T12:54:57.040 INFO:teuthology.orchestra.run.smithi026.stderr: 79500K .......... .......... .......... .......... .......... 85% 115M 0s 2020-04-28T12:54:57.040 INFO:teuthology.orchestra.run.smithi026.stderr: 79550K .......... .......... .......... .......... .......... 85% 74.6M 0s 2020-04-28T12:54:57.040 INFO:teuthology.orchestra.run.smithi026.stderr: 79600K .......... .......... .......... .......... .......... 85% 118M 0s 2020-04-28T12:54:57.040 INFO:teuthology.orchestra.run.smithi026.stderr: 79650K .......... .......... .......... .......... .......... 85% 109M 0s 2020-04-28T12:54:57.041 INFO:teuthology.orchestra.run.smithi026.stderr: 79700K .......... .......... .......... .......... .......... 85% 151M 0s 2020-04-28T12:54:57.041 INFO:teuthology.orchestra.run.smithi026.stderr: 79750K .......... .......... .......... .......... .......... 85% 117M 0s 2020-04-28T12:54:57.041 INFO:teuthology.orchestra.run.smithi026.stderr: 79800K .......... .......... .......... .......... .......... 85% 110M 0s 2020-04-28T12:54:57.041 INFO:teuthology.orchestra.run.smithi026.stderr: 79850K .......... .......... .......... .......... .......... 86% 111M 0s 2020-04-28T12:54:57.041 INFO:teuthology.orchestra.run.smithi026.stderr: 79900K .......... .......... .......... .......... .......... 86% 125M 0s 2020-04-28T12:54:57.041 INFO:teuthology.orchestra.run.smithi026.stderr: 79950K .......... .......... .......... .......... .......... 86% 87.9M 0s 2020-04-28T12:54:57.042 INFO:teuthology.orchestra.run.smithi026.stderr: 80000K .......... .......... .......... .......... .......... 86% 118M 0s 2020-04-28T12:54:57.042 INFO:teuthology.orchestra.run.smithi026.stderr: 80050K .......... .......... .......... .......... .......... 86% 90.4M 0s 2020-04-28T12:54:57.042 INFO:teuthology.orchestra.run.smithi026.stderr: 80100K .......... .......... .......... .......... .......... 86% 156M 0s 2020-04-28T12:54:57.042 INFO:teuthology.orchestra.run.smithi026.stderr: 80150K .......... .......... .......... .......... .......... 86% 115M 0s 2020-04-28T12:54:57.042 INFO:teuthology.orchestra.run.smithi026.stderr: 80200K .......... .......... .......... .......... .......... 86% 114M 0s 2020-04-28T12:54:57.043 INFO:teuthology.orchestra.run.smithi026.stderr: 80250K .......... .......... .......... .......... .......... 86% 114M 0s 2020-04-28T12:54:57.043 INFO:teuthology.orchestra.run.smithi026.stderr: 80300K .......... .......... .......... .......... .......... 86% 118M 0s 2020-04-28T12:54:57.043 INFO:teuthology.orchestra.run.smithi026.stderr: 80350K .......... .......... .......... .......... .......... 86% 85.8M 0s 2020-04-28T12:54:57.043 INFO:teuthology.orchestra.run.smithi026.stderr: 80400K .......... .......... .......... .......... .......... 86% 124M 0s 2020-04-28T12:54:57.043 INFO:teuthology.orchestra.run.smithi026.stderr: 80450K .......... .......... .......... .......... .......... 86% 112M 0s 2020-04-28T12:54:57.043 INFO:teuthology.orchestra.run.smithi026.stderr: 80500K .......... .......... .......... .......... .......... 86% 98.2M 0s 2020-04-28T12:54:57.043 INFO:teuthology.orchestra.run.smithi026.stderr: 80550K .......... .......... .......... .......... .......... 86% 131M 0s 2020-04-28T12:54:57.044 INFO:teuthology.orchestra.run.smithi026.stderr: 80600K .......... .......... .......... .......... .......... 86% 121M 0s 2020-04-28T12:54:57.044 INFO:teuthology.orchestra.run.smithi026.stderr: 80650K .......... .......... .......... .......... .......... 86% 117M 0s 2020-04-28T12:54:57.044 INFO:teuthology.orchestra.run.smithi026.stderr: 80700K .......... .......... .......... .......... .......... 86% 117M 0s 2020-04-28T12:54:57.044 INFO:teuthology.orchestra.run.smithi026.stderr: 80750K .......... .......... .......... .......... .......... 86% 84.7M 0s 2020-04-28T12:54:57.044 INFO:teuthology.orchestra.run.smithi026.stderr: 80800K .......... .......... .......... .......... .......... 87% 125M 0s 2020-04-28T12:54:57.044 INFO:teuthology.orchestra.run.smithi026.stderr: 80850K .......... .......... .......... .......... .......... 87% 118M 0s 2020-04-28T12:54:57.044 INFO:teuthology.orchestra.run.smithi026.stderr: 80900K .......... .......... .......... .......... .......... 87% 116M 0s 2020-04-28T12:54:57.045 INFO:teuthology.orchestra.run.smithi026.stderr: 80950K .......... .......... .......... .......... .......... 87% 112M 0s 2020-04-28T12:54:57.045 INFO:teuthology.orchestra.run.smithi026.stderr: 81000K .......... .......... .......... .......... .......... 87% 109M 0s 2020-04-28T12:54:57.045 INFO:teuthology.orchestra.run.smithi026.stderr: 81050K .......... .......... .......... .......... .......... 87% 100M 0s 2020-04-28T12:54:57.045 INFO:teuthology.orchestra.run.smithi026.stderr: 81100K .......... .......... .......... .......... .......... 87% 113M 0s 2020-04-28T12:54:57.045 INFO:teuthology.orchestra.run.smithi026.stderr: 81150K .......... .......... .......... .......... .......... 87% 109M 0s 2020-04-28T12:54:57.045 INFO:teuthology.orchestra.run.smithi026.stderr: 81200K .......... .......... .......... .......... .......... 87% 98.5M 0s 2020-04-28T12:54:57.046 INFO:teuthology.orchestra.run.smithi026.stderr: 81250K .......... .......... .......... .......... .......... 87% 126M 0s 2020-04-28T12:54:57.046 INFO:teuthology.orchestra.run.smithi026.stderr: 81300K .......... .......... .......... .......... .......... 87% 126M 0s 2020-04-28T12:54:57.046 INFO:teuthology.orchestra.run.smithi026.stderr: 81350K .......... .......... .......... .......... .......... 87% 60.6M 0s 2020-04-28T12:54:57.046 INFO:teuthology.orchestra.run.smithi026.stderr: 81400K .......... .......... .......... .......... .......... 87% 187M 0s 2020-04-28T12:54:57.046 INFO:teuthology.orchestra.run.smithi026.stderr: 81450K .......... .......... .......... .......... .......... 87% 205M 0s 2020-04-28T12:54:57.046 INFO:teuthology.orchestra.run.smithi026.stderr: 81500K .......... .......... .......... .......... .......... 87% 133M 0s 2020-04-28T12:54:57.047 INFO:teuthology.orchestra.run.smithi026.stderr: 81550K .......... .......... .......... .......... .......... 87% 90.3M 0s 2020-04-28T12:54:57.047 INFO:teuthology.orchestra.run.smithi026.stderr: 81600K .......... .......... .......... .......... .......... 87% 118M 0s 2020-04-28T12:54:57.047 INFO:teuthology.orchestra.run.smithi026.stderr: 81650K .......... .......... .......... .......... .......... 87% 98.8M 0s 2020-04-28T12:54:57.047 INFO:teuthology.orchestra.run.smithi026.stderr: 81700K .......... .......... .......... .......... .......... 87% 126M 0s 2020-04-28T12:54:57.047 INFO:teuthology.orchestra.run.smithi026.stderr: 81750K .......... .......... .......... .......... .......... 88% 120M 0s 2020-04-28T12:54:57.047 INFO:teuthology.orchestra.run.smithi026.stderr: 81800K .......... .......... .......... .......... .......... 88% 66.9M 0s 2020-04-28T12:54:57.048 INFO:teuthology.orchestra.run.smithi026.stderr: 81850K .......... .......... .......... .......... .......... 88% 203M 0s 2020-04-28T12:54:57.048 INFO:teuthology.orchestra.run.smithi026.stderr: 81900K .......... .......... .......... .......... .......... 88% 152M 0s 2020-04-28T12:54:57.048 INFO:teuthology.orchestra.run.smithi026.stderr: 81950K .......... .......... .......... .......... .......... 88% 97.8M 0s 2020-04-28T12:54:57.048 INFO:teuthology.orchestra.run.smithi026.stderr: 82000K .......... .......... .......... .......... .......... 88% 105M 0s 2020-04-28T12:54:57.048 INFO:teuthology.orchestra.run.smithi026.stderr: 82050K .......... .......... .......... .......... .......... 88% 135M 0s 2020-04-28T12:54:57.048 INFO:teuthology.orchestra.run.smithi026.stderr: 82100K .......... .......... .......... .......... .......... 88% 117M 0s 2020-04-28T12:54:57.048 INFO:teuthology.orchestra.run.smithi026.stderr: 82150K .......... .......... .......... .......... .......... 88% 111M 0s 2020-04-28T12:54:57.049 INFO:teuthology.orchestra.run.smithi026.stderr: 82200K .......... .......... .......... .......... .......... 88% 120M 0s 2020-04-28T12:54:57.049 INFO:teuthology.orchestra.run.smithi026.stderr: 82250K .......... .......... .......... .......... .......... 88% 113M 0s 2020-04-28T12:54:57.049 INFO:teuthology.orchestra.run.smithi026.stderr: 82300K .......... .......... .......... .......... .......... 88% 109M 0s 2020-04-28T12:54:57.049 INFO:teuthology.orchestra.run.smithi026.stderr: 82350K .......... .......... .......... .......... .......... 88% 92.8M 0s 2020-04-28T12:54:57.049 INFO:teuthology.orchestra.run.smithi026.stderr: 82400K .......... .......... .......... .......... .......... 88% 114M 0s 2020-04-28T12:54:57.049 INFO:teuthology.orchestra.run.smithi026.stderr: 82450K .......... .......... .......... .......... .......... 88% 119M 0s 2020-04-28T12:54:57.050 INFO:teuthology.orchestra.run.smithi026.stderr: 82500K .......... .......... .......... .......... .......... 88% 117M 0s 2020-04-28T12:54:57.050 INFO:teuthology.orchestra.run.smithi026.stderr: 82550K .......... .......... .......... .......... .......... 88% 109M 0s 2020-04-28T12:54:57.050 INFO:teuthology.orchestra.run.smithi026.stderr: 82600K .......... .......... .......... .......... .......... 88% 116M 0s 2020-04-28T12:54:57.050 INFO:teuthology.orchestra.run.smithi026.stderr: 82650K .......... .......... .......... .......... .......... 89% 108M 0s 2020-04-28T12:54:57.050 INFO:teuthology.orchestra.run.smithi026.stderr: 82700K .......... .......... .......... .......... .......... 89% 122M 0s 2020-04-28T12:54:57.050 INFO:teuthology.orchestra.run.smithi026.stderr: 82750K .......... .......... .......... .......... .......... 89% 83.8M 0s 2020-04-28T12:54:57.050 INFO:teuthology.orchestra.run.smithi026.stderr: 82800K .......... .......... .......... .......... .......... 89% 117M 0s 2020-04-28T12:54:57.051 INFO:teuthology.orchestra.run.smithi026.stderr: 82850K .......... .......... .......... .......... .......... 89% 110M 0s 2020-04-28T12:54:57.051 INFO:teuthology.orchestra.run.smithi026.stderr: 82900K .......... .......... .......... .......... .......... 89% 101M 0s 2020-04-28T12:54:57.051 INFO:teuthology.orchestra.run.smithi026.stderr: 82950K .......... .......... .......... .......... .......... 89% 158M 0s 2020-04-28T12:54:57.051 INFO:teuthology.orchestra.run.smithi026.stderr: 83000K .......... .......... .......... .......... .......... 89% 114M 0s 2020-04-28T12:54:57.051 INFO:teuthology.orchestra.run.smithi026.stderr: 83050K .......... .......... .......... .......... .......... 89% 115M 0s 2020-04-28T12:54:57.051 INFO:teuthology.orchestra.run.smithi026.stderr: 83100K .......... .......... .......... .......... .......... 89% 115M 0s 2020-04-28T12:54:57.052 INFO:teuthology.orchestra.run.smithi026.stderr: 83150K .......... .......... .......... .......... .......... 89% 90.0M 0s 2020-04-28T12:54:57.052 INFO:teuthology.orchestra.run.smithi026.stderr: 83200K .......... .......... .......... .......... .......... 89% 114M 0s 2020-04-28T12:54:57.052 INFO:teuthology.orchestra.run.smithi026.stderr: 83250K .......... .......... .......... .......... .......... 89% 119M 0s 2020-04-28T12:54:57.052 INFO:teuthology.orchestra.run.smithi026.stderr: 83300K .......... .......... .......... .......... .......... 89% 114M 0s 2020-04-28T12:54:57.052 INFO:teuthology.orchestra.run.smithi026.stderr: 83350K .......... .......... .......... .......... .......... 89% 107M 0s 2020-04-28T12:54:57.052 INFO:teuthology.orchestra.run.smithi026.stderr: 83400K .......... .......... .......... .......... .......... 89% 113M 0s 2020-04-28T12:54:57.053 INFO:teuthology.orchestra.run.smithi026.stderr: 83450K .......... .......... .......... .......... .......... 89% 122M 0s 2020-04-28T12:54:57.053 INFO:teuthology.orchestra.run.smithi026.stderr: 83500K .......... .......... .......... .......... .......... 89% 116M 0s 2020-04-28T12:54:57.053 INFO:teuthology.orchestra.run.smithi026.stderr: 83550K .......... .......... .......... .......... .......... 89% 81.9M 0s 2020-04-28T12:54:57.053 INFO:teuthology.orchestra.run.smithi026.stderr: 83600K .......... .......... .......... .......... .......... 90% 130M 0s 2020-04-28T12:54:57.053 INFO:teuthology.orchestra.run.smithi026.stderr: 83650K .......... .......... .......... .......... .......... 90% 117M 0s 2020-04-28T12:54:57.053 INFO:teuthology.orchestra.run.smithi026.stderr: 83700K .......... .......... .......... .......... .......... 90% 118M 0s 2020-04-28T12:54:57.054 INFO:teuthology.orchestra.run.smithi026.stderr: 83750K .......... .......... .......... .......... .......... 90% 106M 0s 2020-04-28T12:54:57.054 INFO:teuthology.orchestra.run.smithi026.stderr: 83800K .......... .......... .......... .......... .......... 90% 113M 0s 2020-04-28T12:54:57.054 INFO:teuthology.orchestra.run.smithi026.stderr: 83850K .......... .......... .......... .......... .......... 90% 113M 0s 2020-04-28T12:54:57.054 INFO:teuthology.orchestra.run.smithi026.stderr: 83900K .......... .......... .......... .......... .......... 90% 107M 0s 2020-04-28T12:54:57.054 INFO:teuthology.orchestra.run.smithi026.stderr: 83950K .......... .......... .......... .......... .......... 90% 97.0M 0s 2020-04-28T12:54:57.054 INFO:teuthology.orchestra.run.smithi026.stderr: 84000K .......... .......... .......... .......... .......... 90% 118M 0s 2020-04-28T12:54:57.054 INFO:teuthology.orchestra.run.smithi026.stderr: 84050K .......... .......... .......... .......... .......... 90% 117M 0s 2020-04-28T12:54:57.055 INFO:teuthology.orchestra.run.smithi026.stderr: 84100K .......... .......... .......... .......... .......... 90% 97.7M 0s 2020-04-28T12:54:57.055 INFO:teuthology.orchestra.run.smithi026.stderr: 84150K .......... .......... .......... .......... .......... 90% 113M 0s 2020-04-28T12:54:57.055 INFO:teuthology.orchestra.run.smithi026.stderr: 84200K .......... .......... .......... .......... .......... 90% 56.2M 0s 2020-04-28T12:54:57.055 INFO:teuthology.orchestra.run.smithi026.stderr: 84250K .......... .......... .......... .......... .......... 90% 68.3M 0s 2020-04-28T12:54:57.055 INFO:teuthology.orchestra.run.smithi026.stderr: 84300K .......... .......... .......... .......... .......... 90% 62.0M 0s 2020-04-28T12:54:57.055 INFO:teuthology.orchestra.run.smithi026.stderr: 84350K .......... .......... .......... .......... .......... 90% 54.4M 0s 2020-04-28T12:54:57.056 INFO:teuthology.orchestra.run.smithi026.stderr: 84400K .......... .......... .......... .......... .......... 90% 106M 0s 2020-04-28T12:54:57.056 INFO:teuthology.orchestra.run.smithi026.stderr: 84450K .......... .......... .......... .......... .......... 90% 57.5M 0s 2020-04-28T12:54:57.056 INFO:teuthology.orchestra.run.smithi026.stderr: 84500K .......... .......... .......... .......... .......... 91% 104M 0s 2020-04-28T12:54:57.056 INFO:teuthology.orchestra.run.smithi026.stderr: 84550K .......... .......... .......... .......... .......... 91% 97.4M 0s 2020-04-28T12:54:57.056 INFO:teuthology.orchestra.run.smithi026.stderr: 84600K .......... .......... .......... .......... .......... 91% 93.2M 0s 2020-04-28T12:54:57.056 INFO:teuthology.orchestra.run.smithi026.stderr: 84650K .......... .......... .......... .......... .......... 91% 117M 0s 2020-04-28T12:54:57.056 INFO:teuthology.orchestra.run.smithi026.stderr: 84700K .......... .......... .......... .......... .......... 91% 91.2M 0s 2020-04-28T12:54:57.057 INFO:teuthology.orchestra.run.smithi026.stderr: 84750K .......... .......... .......... .......... .......... 91% 75.5M 0s 2020-04-28T12:54:57.057 INFO:teuthology.orchestra.run.smithi026.stderr: 84800K .......... .......... .......... .......... .......... 91% 100M 0s 2020-04-28T12:54:57.057 INFO:teuthology.orchestra.run.smithi026.stderr: 84850K .......... .......... .......... .......... .......... 91% 97.6M 0s 2020-04-28T12:54:57.057 INFO:teuthology.orchestra.run.smithi026.stderr: 84900K .......... .......... .......... .......... .......... 91% 113M 0s 2020-04-28T12:54:57.057 INFO:teuthology.orchestra.run.smithi026.stderr: 84950K .......... .......... .......... .......... .......... 91% 94.0M 0s 2020-04-28T12:54:57.057 INFO:teuthology.orchestra.run.smithi026.stderr: 85000K .......... .......... .......... .......... .......... 91% 96.2M 0s 2020-04-28T12:54:57.058 INFO:teuthology.orchestra.run.smithi026.stderr: 85050K .......... .......... .......... .......... .......... 91% 101M 0s 2020-04-28T12:54:57.058 INFO:teuthology.orchestra.run.smithi026.stderr: 85100K .......... .......... .......... .......... .......... 91% 117M 0s 2020-04-28T12:54:57.058 INFO:teuthology.orchestra.run.smithi026.stderr: 85150K .......... .......... .......... .......... .......... 91% 75.0M 0s 2020-04-28T12:54:57.058 INFO:teuthology.orchestra.run.smithi026.stderr: 85200K .......... .......... .......... .......... .......... 91% 119M 0s 2020-04-28T12:54:57.058 INFO:teuthology.orchestra.run.smithi026.stderr: 85250K .......... .......... .......... .......... .......... 91% 102M 0s 2020-04-28T12:54:57.058 INFO:teuthology.orchestra.run.smithi026.stderr: 85300K .......... .......... .......... .......... .......... 91% 101M 0s 2020-04-28T12:54:57.059 INFO:teuthology.orchestra.run.smithi026.stderr: 85350K .......... .......... .......... .......... .......... 91% 100M 0s 2020-04-28T12:54:57.059 INFO:teuthology.orchestra.run.smithi026.stderr: 85400K .......... .......... .......... .......... .......... 91% 116M 0s 2020-04-28T12:54:57.059 INFO:teuthology.orchestra.run.smithi026.stderr: 85450K .......... .......... .......... .......... .......... 92% 108M 0s 2020-04-28T12:54:57.059 INFO:teuthology.orchestra.run.smithi026.stderr: 85500K .......... .......... .......... .......... .......... 92% 105M 0s 2020-04-28T12:54:57.059 INFO:teuthology.orchestra.run.smithi026.stderr: 85550K .......... .......... .......... .......... .......... 92% 85.1M 0s 2020-04-28T12:54:57.059 INFO:teuthology.orchestra.run.smithi026.stderr: 85600K .......... .......... .......... .......... .......... 92% 107M 0s 2020-04-28T12:54:57.059 INFO:teuthology.orchestra.run.smithi026.stderr: 85650K .......... .......... .......... .......... .......... 92% 120M 0s 2020-04-28T12:54:57.060 INFO:teuthology.orchestra.run.smithi026.stderr: 85700K .......... .......... .......... .......... .......... 92% 104M 0s 2020-04-28T12:54:57.060 INFO:teuthology.orchestra.run.smithi026.stderr: 85750K .......... .......... .......... .......... .......... 92% 96.9M 0s 2020-04-28T12:54:57.060 INFO:teuthology.orchestra.run.smithi026.stderr: 85800K .......... .......... .......... .......... .......... 92% 114M 0s 2020-04-28T12:54:57.060 INFO:teuthology.orchestra.run.smithi026.stderr: 85850K .......... .......... .......... .......... .......... 92% 120M 0s 2020-04-28T12:54:57.060 INFO:teuthology.orchestra.run.smithi026.stderr: 85900K .......... .......... .......... .......... .......... 92% 108M 0s 2020-04-28T12:54:57.060 INFO:teuthology.orchestra.run.smithi026.stderr: 85950K .......... .......... .......... .......... .......... 92% 85.7M 0s 2020-04-28T12:54:57.060 INFO:teuthology.orchestra.run.smithi026.stderr: 86000K .......... .......... .......... .......... .......... 92% 103M 0s 2020-04-28T12:54:57.061 INFO:teuthology.orchestra.run.smithi026.stderr: 86050K .......... .......... .......... .......... .......... 92% 99.2M 0s 2020-04-28T12:54:57.061 INFO:teuthology.orchestra.run.smithi026.stderr: 86100K .......... .......... .......... .......... .......... 92% 124M 0s 2020-04-28T12:54:57.061 INFO:teuthology.orchestra.run.smithi026.stderr: 86150K .......... .......... .......... .......... .......... 92% 63.3M 0s 2020-04-28T12:54:57.061 INFO:teuthology.orchestra.run.smithi026.stderr: 86200K .......... .......... .......... .......... .......... 92% 196M 0s 2020-04-28T12:54:57.061 INFO:teuthology.orchestra.run.smithi026.stderr: 86250K .......... .......... .......... .......... .......... 92% 118M 0s 2020-04-28T12:54:57.061 INFO:teuthology.orchestra.run.smithi026.stderr: 86300K .......... .......... .......... .......... .......... 92% 125M 0s 2020-04-28T12:54:57.062 INFO:teuthology.orchestra.run.smithi026.stderr: 86350K .......... .......... .......... .......... .......... 93% 89.3M 0s 2020-04-28T12:54:57.062 INFO:teuthology.orchestra.run.smithi026.stderr: 86400K .......... .......... .......... .......... .......... 93% 113M 0s 2020-04-28T12:54:57.062 INFO:teuthology.orchestra.run.smithi026.stderr: 86450K .......... .......... .......... .......... .......... 93% 111M 0s 2020-04-28T12:54:57.062 INFO:teuthology.orchestra.run.smithi026.stderr: 86500K .......... .......... .......... .......... .......... 93% 96.3M 0s 2020-04-28T12:54:57.062 INFO:teuthology.orchestra.run.smithi026.stderr: 86550K .......... .......... .......... .......... .......... 93% 91.8M 0s 2020-04-28T12:54:57.062 INFO:teuthology.orchestra.run.smithi026.stderr: 86600K .......... .......... .......... .......... .......... 93% 126M 0s 2020-04-28T12:54:57.063 INFO:teuthology.orchestra.run.smithi026.stderr: 86650K .......... .......... .......... .......... .......... 93% 125M 0s 2020-04-28T12:54:57.063 INFO:teuthology.orchestra.run.smithi026.stderr: 86700K .......... .......... .......... .......... .......... 93% 111M 0s 2020-04-28T12:54:57.063 INFO:teuthology.orchestra.run.smithi026.stderr: 86750K .......... .......... .......... .......... .......... 93% 86.4M 0s 2020-04-28T12:54:57.063 INFO:teuthology.orchestra.run.smithi026.stderr: 86800K .......... .......... .......... .......... .......... 93% 103M 0s 2020-04-28T12:54:57.063 INFO:teuthology.orchestra.run.smithi026.stderr: 86850K .......... .......... .......... .......... .......... 93% 112M 0s 2020-04-28T12:54:57.063 INFO:teuthology.orchestra.run.smithi026.stderr: 86900K .......... .......... .......... .......... .......... 93% 112M 0s 2020-04-28T12:54:57.063 INFO:teuthology.orchestra.run.smithi026.stderr: 86950K .......... .......... .......... .......... .......... 93% 106M 0s 2020-04-28T12:54:57.064 INFO:teuthology.orchestra.run.smithi026.stderr: 87000K .......... .......... .......... .......... .......... 93% 107M 0s 2020-04-28T12:54:57.064 INFO:teuthology.orchestra.run.smithi026.stderr: 87050K .......... .......... .......... .......... .......... 93% 110M 0s 2020-04-28T12:54:57.064 INFO:teuthology.orchestra.run.smithi026.stderr: 87100K .......... .......... .......... .......... .......... 93% 115M 0s 2020-04-28T12:54:57.064 INFO:teuthology.orchestra.run.smithi026.stderr: 87150K .......... .......... .......... .......... .......... 93% 86.0M 0s 2020-04-28T12:54:57.064 INFO:teuthology.orchestra.run.smithi026.stderr: 87200K .......... .......... .......... .......... .......... 93% 102M 0s 2020-04-28T12:54:57.064 INFO:teuthology.orchestra.run.smithi026.stderr: 87250K .......... .......... .......... .......... .......... 93% 114M 0s 2020-04-28T12:54:57.065 INFO:teuthology.orchestra.run.smithi026.stderr: 87300K .......... .......... .......... .......... .......... 94% 110M 0s 2020-04-28T12:54:57.065 INFO:teuthology.orchestra.run.smithi026.stderr: 87350K .......... .......... .......... .......... .......... 94% 102M 0s 2020-04-28T12:54:57.065 INFO:teuthology.orchestra.run.smithi026.stderr: 87400K .......... .......... .......... .......... .......... 94% 106M 0s 2020-04-28T12:54:57.065 INFO:teuthology.orchestra.run.smithi026.stderr: 87450K .......... .......... .......... .......... .......... 94% 106M 0s 2020-04-28T12:54:57.065 INFO:teuthology.orchestra.run.smithi026.stderr: 87500K .......... .......... .......... .......... .......... 94% 118M 0s 2020-04-28T12:54:57.065 INFO:teuthology.orchestra.run.smithi026.stderr: 87550K .......... .......... .......... .......... .......... 94% 80.6M 0s 2020-04-28T12:54:57.066 INFO:teuthology.orchestra.run.smithi026.stderr: 87600K .......... .......... .......... .......... .......... 94% 127M 0s 2020-04-28T12:54:57.066 INFO:teuthology.orchestra.run.smithi026.stderr: 87650K .......... .......... .......... .......... .......... 94% 109M 0s 2020-04-28T12:54:57.066 INFO:teuthology.orchestra.run.smithi026.stderr: 87700K .......... .......... .......... .......... .......... 94% 108M 0s 2020-04-28T12:54:57.066 INFO:teuthology.orchestra.run.smithi026.stderr: 87750K .......... .......... .......... .......... .......... 94% 94.0M 0s 2020-04-28T12:54:57.066 INFO:teuthology.orchestra.run.smithi026.stderr: 87800K .......... .......... .......... .......... .......... 94% 117M 0s 2020-04-28T12:54:57.067 INFO:teuthology.orchestra.run.smithi026.stderr: 87850K .......... .......... .......... .......... .......... 94% 120M 0s 2020-04-28T12:54:57.067 INFO:teuthology.orchestra.run.smithi026.stderr: 87900K .......... .......... .......... .......... .......... 94% 108M 0s 2020-04-28T12:54:57.067 INFO:teuthology.orchestra.run.smithi026.stderr: 87950K .......... .......... .......... .......... .......... 94% 83.3M 0s 2020-04-28T12:54:57.067 INFO:teuthology.orchestra.run.smithi026.stderr: 88000K .......... .......... .......... .......... .......... 94% 109M 0s 2020-04-28T12:54:57.067 INFO:teuthology.orchestra.run.smithi026.stderr: 88050K .......... .......... .......... .......... .......... 94% 103M 0s 2020-04-28T12:54:57.067 INFO:teuthology.orchestra.run.smithi026.stderr: 88100K .......... .......... .......... .......... .......... 94% 124M 0s 2020-04-28T12:54:57.068 INFO:teuthology.orchestra.run.smithi026.stderr: 88150K .......... .......... .......... .......... .......... 94% 105M 0s 2020-04-28T12:54:57.068 INFO:teuthology.orchestra.run.smithi026.stderr: 88200K .......... .......... .......... .......... .......... 94% 106M 0s 2020-04-28T12:54:57.068 INFO:teuthology.orchestra.run.smithi026.stderr: 88250K .......... .......... .......... .......... .......... 95% 106M 0s 2020-04-28T12:54:57.068 INFO:teuthology.orchestra.run.smithi026.stderr: 88300K .......... .......... .......... .......... .......... 95% 122M 0s 2020-04-28T12:54:57.068 INFO:teuthology.orchestra.run.smithi026.stderr: 88350K .......... .......... .......... .......... .......... 95% 84.6M 0s 2020-04-28T12:54:57.068 INFO:teuthology.orchestra.run.smithi026.stderr: 88400K .......... .......... .......... .......... .......... 95% 107M 0s 2020-04-28T12:54:57.068 INFO:teuthology.orchestra.run.smithi026.stderr: 88450K .......... .......... .......... .......... .......... 95% 107M 0s 2020-04-28T12:54:57.069 INFO:teuthology.orchestra.run.smithi026.stderr: 88500K .......... .......... .......... .......... .......... 95% 108M 0s 2020-04-28T12:54:57.069 INFO:teuthology.orchestra.run.smithi026.stderr: 88550K .......... .......... .......... .......... .......... 95% 115M 0s 2020-04-28T12:54:57.069 INFO:teuthology.orchestra.run.smithi026.stderr: 88600K .......... .......... .......... .......... .......... 95% 108M 0s 2020-04-28T12:54:57.069 INFO:teuthology.orchestra.run.smithi026.stderr: 88650K .......... .......... .......... .......... .......... 95% 103M 0s 2020-04-28T12:54:57.069 INFO:teuthology.orchestra.run.smithi026.stderr: 88700K .......... .......... .......... .......... .......... 95% 108M 0s 2020-04-28T12:54:57.069 INFO:teuthology.orchestra.run.smithi026.stderr: 88750K .......... .......... .......... .......... .......... 95% 82.5M 0s 2020-04-28T12:54:57.069 INFO:teuthology.orchestra.run.smithi026.stderr: 88800K .......... .......... .......... .......... .......... 95% 106M 0s 2020-04-28T12:54:57.070 INFO:teuthology.orchestra.run.smithi026.stderr: 88850K .......... .......... .......... .......... .......... 95% 111M 0s 2020-04-28T12:54:57.070 INFO:teuthology.orchestra.run.smithi026.stderr: 88900K .......... .......... .......... .......... .......... 95% 105M 0s 2020-04-28T12:54:57.070 INFO:teuthology.orchestra.run.smithi026.stderr: 88950K .......... .......... .......... .......... .......... 95% 120M 0s 2020-04-28T12:54:57.070 INFO:teuthology.orchestra.run.smithi026.stderr: 89000K .......... .......... .......... .......... .......... 95% 110M 0s 2020-04-28T12:54:57.070 INFO:teuthology.orchestra.run.smithi026.stderr: 89050K .......... .......... .......... .......... .......... 95% 103M 0s 2020-04-28T12:54:57.070 INFO:teuthology.orchestra.run.smithi026.stderr: 89100K .......... .......... .......... .......... .......... 95% 115M 0s 2020-04-28T12:54:57.070 INFO:teuthology.orchestra.run.smithi026.stderr: 89150K .......... .......... .......... .......... .......... 96% 86.5M 0s 2020-04-28T12:54:57.071 INFO:teuthology.orchestra.run.smithi026.stderr: 89200K .......... .......... .......... .......... .......... 96% 111M 0s 2020-04-28T12:54:57.071 INFO:teuthology.orchestra.run.smithi026.stderr: 89250K .......... .......... .......... .......... .......... 96% 104M 0s 2020-04-28T12:54:57.071 INFO:teuthology.orchestra.run.smithi026.stderr: 89300K .......... .......... .......... .......... .......... 96% 120M 0s 2020-04-28T12:54:57.072 INFO:teuthology.orchestra.run.smithi026.stderr: 89350K .......... .......... .......... .......... .......... 96% 104M 0s 2020-04-28T12:54:57.072 INFO:teuthology.orchestra.run.smithi026.stderr: 89400K .......... .......... .......... .......... .......... 96% 110M 0s 2020-04-28T12:54:57.072 INFO:teuthology.orchestra.run.smithi026.stderr: 89450K .......... .......... .......... .......... .......... 96% 103M 0s 2020-04-28T12:54:57.072 INFO:teuthology.orchestra.run.smithi026.stderr: 89500K .......... .......... .......... .......... .......... 96% 108M 0s 2020-04-28T12:54:57.072 INFO:teuthology.orchestra.run.smithi026.stderr: 89550K .......... .......... .......... .......... .......... 96% 84.2M 0s 2020-04-28T12:54:57.073 INFO:teuthology.orchestra.run.smithi026.stderr: 89600K .......... .......... .......... .......... .......... 96% 116M 0s 2020-04-28T12:54:57.073 INFO:teuthology.orchestra.run.smithi026.stderr: 89650K .......... .......... .......... .......... .......... 96% 113M 0s 2020-04-28T12:54:57.073 INFO:teuthology.orchestra.run.smithi026.stderr: 89700K .......... .......... .......... .......... .......... 96% 95.5M 0s 2020-04-28T12:54:57.073 INFO:teuthology.orchestra.run.smithi026.stderr: 89750K .......... .......... .......... .......... .......... 96% 117M 0s 2020-04-28T12:54:57.073 INFO:teuthology.orchestra.run.smithi026.stderr: 89800K .......... .......... .......... .......... .......... 96% 114M 0s 2020-04-28T12:54:57.073 INFO:teuthology.orchestra.run.smithi026.stderr: 89850K .......... .......... .......... .......... .......... 96% 110M 0s 2020-04-28T12:54:57.073 INFO:teuthology.orchestra.run.smithi026.stderr: 89900K .......... .......... .......... .......... .......... 96% 109M 0s 2020-04-28T12:54:57.074 INFO:teuthology.orchestra.run.smithi026.stderr: 89950K .......... .......... .......... .......... .......... 96% 78.3M 0s 2020-04-28T12:54:57.074 INFO:teuthology.orchestra.run.smithi026.stderr: 90000K .......... .......... .......... .......... .......... 96% 93.4M 0s 2020-04-28T12:54:57.074 INFO:teuthology.orchestra.run.smithi026.stderr: 90050K .......... .......... .......... .......... .......... 96% 144M 0s 2020-04-28T12:54:57.074 INFO:teuthology.orchestra.run.smithi026.stderr: 90100K .......... .......... .......... .......... .......... 97% 100M 0s 2020-04-28T12:54:57.074 INFO:teuthology.orchestra.run.smithi026.stderr: 90150K .......... .......... .......... .......... .......... 97% 117M 0s 2020-04-28T12:54:57.074 INFO:teuthology.orchestra.run.smithi026.stderr: 90200K .......... .......... .......... .......... .......... 97% 109M 0s 2020-04-28T12:54:57.075 INFO:teuthology.orchestra.run.smithi026.stderr: 90250K .......... .......... .......... .......... .......... 97% 120M 0s 2020-04-28T12:54:57.075 INFO:teuthology.orchestra.run.smithi026.stderr: 90300K .......... .......... .......... .......... .......... 97% 106M 0s 2020-04-28T12:54:57.075 INFO:teuthology.orchestra.run.smithi026.stderr: 90350K .......... .......... .......... .......... .......... 97% 77.8M 0s 2020-04-28T12:54:57.075 INFO:teuthology.orchestra.run.smithi026.stderr: 90400K .......... .......... .......... .......... .......... 97% 94.1M 0s 2020-04-28T12:54:57.075 INFO:teuthology.orchestra.run.smithi026.stderr: 90450K .......... .......... .......... .......... .......... 97% 127M 0s 2020-04-28T12:54:57.075 INFO:teuthology.orchestra.run.smithi026.stderr: 90500K .......... .......... .......... .......... .......... 97% 94.7M 0s 2020-04-28T12:54:57.076 INFO:teuthology.orchestra.run.smithi026.stderr: 90550K .......... .......... .......... .......... .......... 97% 120M 0s 2020-04-28T12:54:57.076 INFO:teuthology.orchestra.run.smithi026.stderr: 90600K .......... .......... .......... .......... .......... 97% 126M 0s 2020-04-28T12:54:57.076 INFO:teuthology.orchestra.run.smithi026.stderr: 90650K .......... .......... .......... .......... .......... 97% 94.9M 0s 2020-04-28T12:54:57.076 INFO:teuthology.orchestra.run.smithi026.stderr: 90700K .......... .......... .......... .......... .......... 97% 127M 0s 2020-04-28T12:54:57.076 INFO:teuthology.orchestra.run.smithi026.stderr: 90750K .......... .......... .......... .......... .......... 97% 77.8M 0s 2020-04-28T12:54:57.076 INFO:teuthology.orchestra.run.smithi026.stderr: 90800K .......... .......... .......... .......... .......... 97% 136M 0s 2020-04-28T12:54:57.076 INFO:teuthology.orchestra.run.smithi026.stderr: 90850K .......... .......... .......... .......... .......... 97% 109M 0s 2020-04-28T12:54:57.077 INFO:teuthology.orchestra.run.smithi026.stderr: 90900K .......... .......... .......... .......... .......... 97% 106M 0s 2020-04-28T12:54:57.077 INFO:teuthology.orchestra.run.smithi026.stderr: 90950K .......... .......... .......... .......... .......... 97% 104M 0s 2020-04-28T12:54:57.077 INFO:teuthology.orchestra.run.smithi026.stderr: 91000K .......... .......... .......... .......... .......... 98% 91.3M 0s 2020-04-28T12:54:57.077 INFO:teuthology.orchestra.run.smithi026.stderr: 91050K .......... .......... .......... .......... .......... 98% 136M 0s 2020-04-28T12:54:57.077 INFO:teuthology.orchestra.run.smithi026.stderr: 91100K .......... .......... .......... .......... .......... 98% 105M 0s 2020-04-28T12:54:57.077 INFO:teuthology.orchestra.run.smithi026.stderr: 91150K .......... .......... .......... .......... .......... 98% 90.8M 0s 2020-04-28T12:54:57.078 INFO:teuthology.orchestra.run.smithi026.stderr: 91200K .......... .......... .......... .......... .......... 98% 106M 0s 2020-04-28T12:54:57.078 INFO:teuthology.orchestra.run.smithi026.stderr: 91250K .......... .......... .......... .......... .......... 98% 108M 0s 2020-04-28T12:54:57.078 INFO:teuthology.orchestra.run.smithi026.stderr: 91300K .......... .......... .......... .......... .......... 98% 118M 0s 2020-04-28T12:54:57.078 INFO:teuthology.orchestra.run.smithi026.stderr: 91350K .......... .......... .......... .......... .......... 98% 103M 0s 2020-04-28T12:54:57.078 INFO:teuthology.orchestra.run.smithi026.stderr: 91400K .......... .......... .......... .......... .......... 98% 106M 0s 2020-04-28T12:54:57.078 INFO:teuthology.orchestra.run.smithi026.stderr: 91450K .......... .......... .......... .......... .......... 98% 112M 0s 2020-04-28T12:54:57.079 INFO:teuthology.orchestra.run.smithi026.stderr: 91500K .......... .......... .......... .......... .......... 98% 120M 0s 2020-04-28T12:54:57.079 INFO:teuthology.orchestra.run.smithi026.stderr: 91550K .......... .......... .......... .......... .......... 98% 81.0M 0s 2020-04-28T12:54:57.079 INFO:teuthology.orchestra.run.smithi026.stderr: 91600K .......... .......... .......... .......... .......... 98% 103M 0s 2020-04-28T12:54:57.079 INFO:teuthology.orchestra.run.smithi026.stderr: 91650K .......... .......... .......... .......... .......... 98% 106M 0s 2020-04-28T12:54:57.079 INFO:teuthology.orchestra.run.smithi026.stderr: 91700K .......... .......... .......... .......... .......... 98% 115M 0s 2020-04-28T12:54:57.079 INFO:teuthology.orchestra.run.smithi026.stderr: 91750K .......... .......... .......... .......... .......... 98% 99.8M 0s 2020-04-28T12:54:57.079 INFO:teuthology.orchestra.run.smithi026.stderr: 91800K .......... .......... .......... .......... .......... 98% 125M 0s 2020-04-28T12:54:57.080 INFO:teuthology.orchestra.run.smithi026.stderr: 91850K .......... .......... .......... .......... .......... 98% 111M 0s 2020-04-28T12:54:57.080 INFO:teuthology.orchestra.run.smithi026.stderr: 91900K .......... .......... .......... .......... .......... 98% 107M 0s 2020-04-28T12:54:57.080 INFO:teuthology.orchestra.run.smithi026.stderr: 91950K .......... .......... .......... .......... .......... 99% 83.8M 0s 2020-04-28T12:54:57.080 INFO:teuthology.orchestra.run.smithi026.stderr: 92000K .......... .......... .......... .......... .......... 99% 107M 0s 2020-04-28T12:54:57.080 INFO:teuthology.orchestra.run.smithi026.stderr: 92050K .......... .......... .......... .......... .......... 99% 99.9M 0s 2020-04-28T12:54:57.080 INFO:teuthology.orchestra.run.smithi026.stderr: 92100K .......... .......... .......... .......... .......... 99% 95.6M 0s 2020-04-28T12:54:57.081 INFO:teuthology.orchestra.run.smithi026.stderr: 92150K .......... .......... .......... .......... .......... 99% 120M 0s 2020-04-28T12:54:57.081 INFO:teuthology.orchestra.run.smithi026.stderr: 92200K .......... .......... .......... .......... .......... 99% 125M 0s 2020-04-28T12:54:57.081 INFO:teuthology.orchestra.run.smithi026.stderr: 92250K .......... .......... .......... .......... .......... 99% 94.6M 0s 2020-04-28T12:54:57.081 INFO:teuthology.orchestra.run.smithi026.stderr: 92300K .......... .......... .......... .......... .......... 99% 127M 0s 2020-04-28T12:54:57.081 INFO:teuthology.orchestra.run.smithi026.stderr: 92350K .......... .......... .......... .......... .......... 99% 77.9M 0s 2020-04-28T12:54:57.081 INFO:teuthology.orchestra.run.smithi026.stderr: 92400K .......... .......... .......... .......... .......... 99% 133M 0s 2020-04-28T12:54:57.082 INFO:teuthology.orchestra.run.smithi026.stderr: 92450K .......... .......... .......... .......... .......... 99% 112M 0s 2020-04-28T12:54:57.082 INFO:teuthology.orchestra.run.smithi026.stderr: 92500K .......... .......... .......... .......... .......... 99% 113M 0s 2020-04-28T12:54:57.082 INFO:teuthology.orchestra.run.smithi026.stderr: 92550K .......... .......... .......... .......... .......... 99% 103M 0s 2020-04-28T12:54:57.082 INFO:teuthology.orchestra.run.smithi026.stderr: 92600K .......... .......... .......... .......... .......... 99% 99.4M 0s 2020-04-28T12:54:57.082 INFO:teuthology.orchestra.run.smithi026.stderr: 92650K .......... .......... .......... .......... .......... 99% 75.7M 0s 2020-04-28T12:54:57.082 INFO:teuthology.orchestra.run.smithi026.stderr: 92700K .......... .......... .......... .......... .......... 99% 106M 0s 2020-04-28T12:54:57.083 INFO:teuthology.orchestra.run.smithi026.stderr: 92750K .......... .......... .......... .......... .......... 99% 114M 0s 2020-04-28T12:54:57.083 INFO:teuthology.orchestra.run.smithi026.stderr: 92800K .......... .......... .......... .......... .......... 99% 151M 0s 2020-04-28T12:54:57.083 INFO:teuthology.orchestra.run.smithi026.stderr: 92850K .......... .......... .......... .......... .......... 99% 134M 0s 2020-04-28T12:54:57.083 INFO:teuthology.orchestra.run.smithi026.stderr: 92900K 100% 134G=1.1s 2020-04-28T12:54:57.083 INFO:teuthology.orchestra.run.smithi026.stderr: 2020-04-28T12:54:57.083 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28 12:54:56 (80.4 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2020-04-28T12:54:57.084 INFO:teuthology.orchestra.run.smithi026.stderr: 2020-04-28T12:54:57.084 INFO:teuthology.orchestra.run.smithi026.stdout:Archive: gradle-6.0.1-bin.zip 2020-04-28T12:54:57.084 INFO:teuthology.orchestra.run.smithi026.stdout: creating: /opt/gradle/gradle-6.0.1/ 2020-04-28T12:54:57.084 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2020-04-28T12:54:57.084 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2020-04-28T12:54:57.084 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2020-04-28T12:54:57.085 INFO:teuthology.orchestra.run.smithi026.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2020-04-28T12:54:57.085 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2020-04-28T12:54:57.085 INFO:teuthology.orchestra.run.smithi026.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2020-04-28T12:54:57.085 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2020-04-28T12:54:57.085 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2020-04-28T12:54:57.085 INFO:teuthology.orchestra.run.smithi026.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2020-04-28T12:54:57.086 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2020-04-28T12:54:57.086 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2020-04-28T12:54:57.086 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2020-04-28T12:54:57.086 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2020-04-28T12:54:57.086 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2020-04-28T12:54:57.087 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2020-04-28T12:54:57.087 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2020-04-28T12:54:57.087 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2020-04-28T12:54:57.087 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2020-04-28T12:54:57.087 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2020-04-28T12:54:57.087 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2020-04-28T12:54:57.088 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2020-04-28T12:54:57.088 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2020-04-28T12:54:57.088 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2020-04-28T12:54:57.088 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2020-04-28T12:54:57.088 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2020-04-28T12:54:57.088 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2020-04-28T12:54:57.088 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2020-04-28T12:54:57.089 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2020-04-28T12:54:57.089 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2020-04-28T12:54:57.089 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2020-04-28T12:54:57.089 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2020-04-28T12:54:57.089 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2020-04-28T12:54:57.089 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2020-04-28T12:54:57.090 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2020-04-28T12:54:57.090 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2020-04-28T12:54:57.090 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2020-04-28T12:54:57.090 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2020-04-28T12:54:57.091 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2020-04-28T12:54:57.091 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2020-04-28T12:54:57.091 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2020-04-28T12:54:57.098 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2020-04-28T12:54:57.098 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2020-04-28T12:54:57.098 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2020-04-28T12:54:57.099 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2020-04-28T12:54:57.099 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2020-04-28T12:54:57.099 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2020-04-28T12:54:57.099 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2020-04-28T12:54:57.100 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2020-04-28T12:54:57.100 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2020-04-28T12:54:57.100 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2020-04-28T12:54:57.100 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2020-04-28T12:54:57.100 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2020-04-28T12:54:57.100 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2020-04-28T12:54:57.101 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2020-04-28T12:54:57.101 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2020-04-28T12:54:57.101 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2020-04-28T12:54:57.101 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2020-04-28T12:54:57.101 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2020-04-28T12:54:57.101 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2020-04-28T12:54:57.101 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2020-04-28T12:54:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2020-04-28T12:54:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2020-04-28T12:54:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2020-04-28T12:54:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2020-04-28T12:54:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2020-04-28T12:54:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2020-04-28T12:54:57.102 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2020-04-28T12:54:57.103 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2020-04-28T12:54:57.103 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2020-04-28T12:54:57.103 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2020-04-28T12:54:57.103 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2020-04-28T12:54:57.103 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2020-04-28T12:54:57.103 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2020-04-28T12:54:57.104 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2020-04-28T12:54:57.104 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2020-04-28T12:54:57.110 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2020-04-28T12:54:57.110 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2020-04-28T12:54:57.119 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2020-04-28T12:54:57.120 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2020-04-28T12:54:57.120 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2020-04-28T12:54:57.120 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2020-04-28T12:54:57.120 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2020-04-28T12:54:57.128 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2020-04-28T12:54:57.128 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2020-04-28T12:54:57.129 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2020-04-28T12:54:57.129 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2020-04-28T12:54:57.129 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2020-04-28T12:54:57.131 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2020-04-28T12:54:57.131 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2020-04-28T12:54:57.131 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2020-04-28T12:54:57.131 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2020-04-28T12:54:57.132 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2020-04-28T12:54:57.132 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2020-04-28T12:54:57.132 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2020-04-28T12:54:57.132 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2020-04-28T12:54:57.134 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2020-04-28T12:54:57.135 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2020-04-28T12:54:57.135 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2020-04-28T12:54:57.135 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2020-04-28T12:54:57.135 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2020-04-28T12:54:57.135 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2020-04-28T12:54:57.135 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2020-04-28T12:54:57.136 INFO:teuthology.orchestra.run.smithi026.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2020-04-28T12:54:57.136 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2020-04-28T12:54:57.136 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2020-04-28T12:54:57.136 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2020-04-28T12:54:57.136 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2020-04-28T12:54:57.137 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2020-04-28T12:54:57.137 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2020-04-28T12:54:57.139 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2020-04-28T12:54:57.141 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2020-04-28T12:54:57.141 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2020-04-28T12:54:57.143 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2020-04-28T12:54:57.143 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2020-04-28T12:54:57.146 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2020-04-28T12:54:57.146 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2020-04-28T12:54:57.147 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2020-04-28T12:54:57.148 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2020-04-28T12:54:57.149 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2020-04-28T12:54:57.149 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2020-04-28T12:54:57.150 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2020-04-28T12:54:57.152 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2020-04-28T12:54:57.153 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2020-04-28T12:54:57.155 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2020-04-28T12:54:57.155 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2020-04-28T12:54:57.156 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2020-04-28T12:54:57.156 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2020-04-28T12:54:57.157 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2020-04-28T12:54:57.157 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2020-04-28T12:54:57.158 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2020-04-28T12:54:57.160 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2020-04-28T12:54:57.160 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2020-04-28T12:54:57.161 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2020-04-28T12:54:57.165 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2020-04-28T12:54:57.167 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2020-04-28T12:54:57.167 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2020-04-28T12:54:57.169 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2020-04-28T12:54:57.170 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2020-04-28T12:54:57.171 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2020-04-28T12:54:57.176 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2020-04-28T12:54:57.177 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2020-04-28T12:54:57.193 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2020-04-28T12:54:57.193 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2020-04-28T12:54:57.193 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2020-04-28T12:54:57.193 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2020-04-28T12:54:57.193 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2020-04-28T12:54:57.194 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2020-04-28T12:54:57.195 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2020-04-28T12:54:57.195 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2020-04-28T12:54:57.195 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2020-04-28T12:54:57.195 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2020-04-28T12:54:57.213 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2020-04-28T12:54:57.213 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2020-04-28T12:54:57.213 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2020-04-28T12:54:57.214 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2020-04-28T12:54:57.215 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2020-04-28T12:54:57.216 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2020-04-28T12:54:57.224 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2020-04-28T12:54:57.226 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2020-04-28T12:54:57.230 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2020-04-28T12:54:57.230 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2020-04-28T12:54:57.230 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2020-04-28T12:54:57.231 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2020-04-28T12:54:57.232 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2020-04-28T12:54:57.232 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2020-04-28T12:54:57.234 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2020-04-28T12:54:57.242 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2020-04-28T12:54:57.244 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2020-04-28T12:54:57.246 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2020-04-28T12:54:57.246 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2020-04-28T12:54:57.247 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2020-04-28T12:54:57.247 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2020-04-28T12:54:57.247 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2020-04-28T12:54:57.249 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2020-04-28T12:54:57.253 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2020-04-28T12:54:57.255 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2020-04-28T12:54:57.256 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2020-04-28T12:54:57.258 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2020-04-28T12:54:57.261 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2020-04-28T12:54:57.261 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2020-04-28T12:54:57.268 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2020-04-28T12:54:57.271 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2020-04-28T12:54:57.278 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2020-04-28T12:54:57.283 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2020-04-28T12:54:57.285 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2020-04-28T12:54:57.286 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2020-04-28T12:54:57.295 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2020-04-28T12:54:57.297 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2020-04-28T12:54:57.304 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2020-04-28T12:54:57.304 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2020-04-28T12:54:57.313 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2020-04-28T12:54:57.315 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2020-04-28T12:54:57.316 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2020-04-28T12:54:57.320 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2020-04-28T12:54:57.326 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2020-04-28T12:54:57.356 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2020-04-28T12:54:57.358 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2020-04-28T12:54:57.358 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2020-04-28T12:54:57.359 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2020-04-28T12:54:57.360 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2020-04-28T12:54:57.360 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2020-04-28T12:54:57.361 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2020-04-28T12:54:57.361 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2020-04-28T12:54:57.363 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2020-04-28T12:54:57.364 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2020-04-28T12:54:57.365 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2020-04-28T12:54:57.365 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2020-04-28T12:54:57.366 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2020-04-28T12:54:57.367 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2020-04-28T12:54:57.367 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2020-04-28T12:54:57.368 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2020-04-28T12:54:57.368 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2020-04-28T12:54:57.369 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2020-04-28T12:54:57.369 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2020-04-28T12:54:57.370 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2020-04-28T12:54:57.370 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2020-04-28T12:54:57.370 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2020-04-28T12:54:57.370 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2020-04-28T12:54:57.371 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2020-04-28T12:54:57.372 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2020-04-28T12:54:57.376 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2020-04-28T12:54:57.377 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2020-04-28T12:54:57.378 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2020-04-28T12:54:57.378 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2020-04-28T12:54:57.378 INFO:teuthology.orchestra.run.smithi026.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2020-04-28T12:54:57.425 INFO:teuthology.orchestra.run.smithi026.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2020-04-28T12:55:05.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.245 INFO:teuthology.orchestra.run.smithi026.stdout:Welcome to Gradle 6.0.1! 2020-04-28T12:55:05.245 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.246 INFO:teuthology.orchestra.run.smithi026.stdout:Here are the highlights of this release: 2020-04-28T12:55:05.246 INFO:teuthology.orchestra.run.smithi026.stdout: - Substantial improvements in dependency management, including 2020-04-28T12:55:05.246 INFO:teuthology.orchestra.run.smithi026.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2020-04-28T12:55:05.246 INFO:teuthology.orchestra.run.smithi026.stdout: - Advanced control of transitive versions 2020-04-28T12:55:05.246 INFO:teuthology.orchestra.run.smithi026.stdout: - Support for optional features and dependencies 2020-04-28T12:55:05.246 INFO:teuthology.orchestra.run.smithi026.stdout: - Rules to tweak published metadata 2020-04-28T12:55:05.246 INFO:teuthology.orchestra.run.smithi026.stdout: - Support for Java 13 2020-04-28T12:55:05.247 INFO:teuthology.orchestra.run.smithi026.stdout: - Faster incremental Java and Groovy compilation 2020-04-28T12:55:05.247 INFO:teuthology.orchestra.run.smithi026.stdout: - New Zinc compiler for Scala 2020-04-28T12:55:05.247 INFO:teuthology.orchestra.run.smithi026.stdout: - VS2019 support 2020-04-28T12:55:05.247 INFO:teuthology.orchestra.run.smithi026.stdout: - Support for Gradle Enterprise plugin 3.0 2020-04-28T12:55:05.247 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.250 INFO:teuthology.orchestra.run.smithi026.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2020-04-28T12:55:05.251 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.251 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.251 INFO:teuthology.orchestra.run.smithi026.stdout:------------------------------------------------------------ 2020-04-28T12:55:05.251 INFO:teuthology.orchestra.run.smithi026.stdout:Gradle 6.0.1 2020-04-28T12:55:05.251 INFO:teuthology.orchestra.run.smithi026.stdout:------------------------------------------------------------ 2020-04-28T12:55:05.251 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout:Build time: 2019-11-18 20:25:01 UTC 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout:Kotlin: 1.3.50 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout:Groovy: 2.5.8 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout:JVM: 1.8.0_252 (Oracle Corporation 25.252-b09) 2020-04-28T12:55:05.252 INFO:teuthology.orchestra.run.smithi026.stdout:OS: Linux 4.18.0-147.8.1.el8_1.x86_64 amd64 2020-04-28T12:55:05.253 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:05.253 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:55:05.269 INFO:teuthology.orchestra.run.smithi026:> sudo keytool -import -alias smithi026.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2020-04-28T12:55:05.700 INFO:teuthology.orchestra.run.smithi026.stderr:Certificate was added to keystore 2020-04-28T12:55:05.708 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2020-04-28T12:55:05.708 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2020-04-28T12:55:05.709 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi026.front.sepia.ceph.com 2020-04-28T12:55:05.709 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2020-04-28T12:55:05.709 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi107.front.sepia.ceph.com 2020-04-28T12:55:05.709 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2020-04-28T12:55:05.943 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2020-04-28T12:55:05.943 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2020-04-28T12:55:05.943 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'YLOTQKBBVYAVWNRDYQLM', 's3dir': 'folder', 'endpoint': 'smithi026.front.sepia.ceph.com:443', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 443, 'access_secret': '3HzHj7wqRD+KmMMIWGnYAiWHk3gLrnuQl/tCp8wNAvJ4PIr0QnlxIg==', 'host': 'smithi026.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': True, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2020-04-28T12:55:05.944 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2020-04-28T12:55:05.944 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'YLOTQKBBVYAVWNRDYQLM', '--secret', '3HzHj7wqRD+KmMMIWGnYAiWHk3gLrnuQl/tCp8wNAvJ4PIr0QnlxIg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2020-04-28T12:55:05.944 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:55:05.959 INFO:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key YLOTQKBBVYAVWNRDYQLM --secret 3HzHj7wqRD+KmMMIWGnYAiWHk3gLrnuQl/tCp8wNAvJ4PIr0QnlxIg== --email tester.client.0_test@test.test --cluster ceph 2020-04-28T12:55:06.048 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.044+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.046+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.050 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.046+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.051 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.046+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.051 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.046+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.051 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.047+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.047+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.052 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.048+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.064+0000 7faadb534180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:55:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.064+0000 7faadb534180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:55:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.064+0000 7faadb534180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:55:06.069 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.064+0000 7faadb534180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:55:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.064+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.065+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.070 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.065+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.065+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:55:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.066+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.071 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.066+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.066+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.067+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:55:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.067+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.067+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.067+0000 7faadb534180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:55:06.072 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.067+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.067+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.067+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.073 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.068+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.068+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.068+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:55:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.068+0000 7faadb534180 20 zonegroup default 2020-04-28T12:55:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.068+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.069+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.069+0000 7faadb534180 10 Cannot find current period zone using local zone 2020-04-28T12:55:06.074 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.069+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.075 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.069+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.075 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.069+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.070+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.070+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.070+0000 7faadb534180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:55:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.070+0000 7faadb534180 20 zone default found 2020-04-28T12:55:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.070+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.070+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.076 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.070+0000 7faadb534180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.077 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.071+0000 7faadb534180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.077 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.071+0000 7faadb534180 20 started sync module instance, tier type = 2020-04-28T12:55:06.077 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.071+0000 7faadb534180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:55:06.077 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.072+0000 7faac9d1e700 0 -- 172.21.15.26:0/2227561388 >> [v2:172.21.15.107:6818/23511,v1:172.21.15.107:6819/23511] conn(0x7faabc008bc0 msgr2=0x7faabc0095d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:55:06.088 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.084+0000 7faadb534180 20 add_watcher() i=0 2020-04-28T12:55:06.088 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.084+0000 7faadb534180 20 add_watcher() i=1 2020-04-28T12:55:06.089 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.084+0000 7faadb534180 20 add_watcher() i=2 2020-04-28T12:55:06.089 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.084+0000 7faadb534180 20 add_watcher() i=3 2020-04-28T12:55:06.089 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.084+0000 7faadb534180 20 add_watcher() i=4 2020-04-28T12:55:06.089 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.084+0000 7faadb534180 20 add_watcher() i=5 2020-04-28T12:55:06.089 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.084+0000 7faadb534180 20 add_watcher() i=6 2020-04-28T12:55:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.085+0000 7faadb534180 20 add_watcher() i=7 2020-04-28T12:55:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.085+0000 7faadb534180 2 all 8 watchers are set, enabling cache 2020-04-28T12:55:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.085+0000 7faadb534180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:55:06.090 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.085+0000 7faadb534180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:55:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.085+0000 7faa99fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:55:06.091 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.086+0000 7faac951d700 0 -- 172.21.15.26:0/2098729070 >> [v2:172.21.15.26:3301/0,v1:172.21.15.26:6790/0] conn(0x55c6145ad5f0 msgr2=0x55c6145ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2020-04-28T12:55:06.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faa0bfff700 20 reqs_thread_entry: start 2020-04-28T12:55:06.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faa09ffb700 20 reqs_thread_entry: start 2020-04-28T12:55:06.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faadb534180 20 init_complete bucket index max shards: 1999 2020-04-28T12:55:06.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7fa9f7fff700 20 reqs_thread_entry: start 2020-04-28T12:55:06.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faadb534180 20 get_system_obj_state: rctx=0x7ffefc7b0d78 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55c614454170 s->prefetch_data=0 2020-04-28T12:55:06.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faadb534180 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2020-04-28T12:55:06.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2020-04-28T12:55:06.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faadb534180 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:55:06.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faadb534180 20 get_system_obj_state: rctx=0x7ffefc7b0d88 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55c614454170 s->prefetch_data=0 2020-04-28T12:55:06.146 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.139+0000 7faadb534180 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2020-04-28T12:55:06.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2020-04-28T12:55:06.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:55:06.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 20 get_system_obj_state: rctx=0x7ffefc7b0d88 obj=default.rgw.meta:users.keys:YLOTQKBBVYAVWNRDYQLM state=0x55c614454170 s->prefetch_data=0 2020-04-28T12:55:06.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 10 cache get: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM : miss 2020-04-28T12:55:06.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM info.flags=0x0 2020-04-28T12:55:06.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 10 adding default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM to cache LRU end 2020-04-28T12:55:06.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 20 get_system_obj_state: rctx=0x7ffefc7b0798 obj=default.rgw.meta:users.keys:YLOTQKBBVYAVWNRDYQLM state=0x55c614454170 s->prefetch_data=0 2020-04-28T12:55:06.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.140+0000 7faadb534180 10 cache get: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM : type miss (requested=0x6, cached=0x0) 2020-04-28T12:55:06.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.141+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM info.flags=0x0 2020-04-28T12:55:06.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.141+0000 7faadb534180 10 moving default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM to cache LRU end 2020-04-28T12:55:06.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.141+0000 7faadb534180 20 get_system_obj_state: rctx=0x7ffefc7b0a88 obj=default.rgw.meta:users.keys:YLOTQKBBVYAVWNRDYQLM state=0x55c614454170 s->prefetch_data=0 2020-04-28T12:55:06.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.141+0000 7faadb534180 10 cache get: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM : type miss (requested=0x6, cached=0x0) 2020-04-28T12:55:06.149 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.141+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM info.flags=0x0 2020-04-28T12:55:06.149 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.141+0000 7faadb534180 10 moving default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM to cache LRU end 2020-04-28T12:55:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.143+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T12:55:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.143+0000 7faadb534180 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:55:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.143+0000 7faadb534180 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2020-04-28T12:55:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.143+0000 7faaaa7fc700 10 RGWWatcher::handle_notify() notify_id 541165879302 cookie 94309233318736 notifier 4929 bl.length()=632 2020-04-28T12:55:06.150 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.143+0000 7faaaa7fc700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2020-04-28T12:55:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.143+0000 7faaaa7fc700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2020-04-28T12:55:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.145+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T12:55:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.145+0000 7faadb534180 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:55:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.145+0000 7faadb534180 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2020-04-28T12:55:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.145+0000 7faaaa7fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94309233308288 notifier 4929 bl.length()=200 2020-04-28T12:55:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.145+0000 7faaaa7fc700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2020-04-28T12:55:06.151 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.145+0000 7faaaa7fc700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2020-04-28T12:55:06.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.148+0000 7faadb534180 10 cache put: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM info.flags=0x7 2020-04-28T12:55:06.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.148+0000 7faadb534180 10 moving default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM to cache LRU end 2020-04-28T12:55:06.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.148+0000 7faadb534180 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=189 2020-04-28T12:55:06.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.148+0000 7faaaa7fc700 10 RGWWatcher::handle_notify() notify_id 541165879298 cookie 94309233320992 notifier 4929 bl.length()=189 2020-04-28T12:55:06.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.148+0000 7faaaa7fc700 10 cache put: name=default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM info.flags=0x7 2020-04-28T12:55:06.153 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.148+0000 7faaaa7fc700 10 moving default.rgw.meta+users.keys+YLOTQKBBVYAVWNRDYQLM to cache LRU end 2020-04-28T12:55:06.154 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.149+0000 7faa99fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:55:06.154 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2020-04-28T12:55:06.154 INFO:teuthology.orchestra.run.smithi026.stdout: "user_id": "tester.client.0", 2020-04-28T12:55:06.155 INFO:teuthology.orchestra.run.smithi026.stdout: "display_name": "Ms. tester.client.0", 2020-04-28T12:55:06.155 INFO:teuthology.orchestra.run.smithi026.stdout: "email": "tester.client.0_test@test.test", 2020-04-28T12:55:06.155 INFO:teuthology.orchestra.run.smithi026.stdout: "suspended": 0, 2020-04-28T12:55:06.155 INFO:teuthology.orchestra.run.smithi026.stdout: "max_buckets": 1000, 2020-04-28T12:55:06.155 INFO:teuthology.orchestra.run.smithi026.stdout: "subusers": [], 2020-04-28T12:55:06.155 INFO:teuthology.orchestra.run.smithi026.stdout: "keys": [ 2020-04-28T12:55:06.155 INFO:teuthology.orchestra.run.smithi026.stdout: { 2020-04-28T12:55:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: "user": "tester.client.0", 2020-04-28T12:55:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: "access_key": "YLOTQKBBVYAVWNRDYQLM", 2020-04-28T12:55:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: "secret_key": "3HzHj7wqRD+KmMMIWGnYAiWHk3gLrnuQl/tCp8wNAvJ4PIr0QnlxIg==" 2020-04-28T12:55:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: } 2020-04-28T12:55:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2020-04-28T12:55:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: "swift_keys": [], 2020-04-28T12:55:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": [], 2020-04-28T12:55:06.157 INFO:teuthology.orchestra.run.smithi026.stdout: "op_mask": "read, write, delete", 2020-04-28T12:55:06.157 INFO:teuthology.orchestra.run.smithi026.stdout: "default_placement": "", 2020-04-28T12:55:06.157 INFO:teuthology.orchestra.run.smithi026.stdout: "default_storage_class": "", 2020-04-28T12:55:06.157 INFO:teuthology.orchestra.run.smithi026.stdout: "placement_tags": [], 2020-04-28T12:55:06.157 INFO:teuthology.orchestra.run.smithi026.stdout: "bucket_quota": { 2020-04-28T12:55:06.158 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": false, 2020-04-28T12:55:06.158 INFO:teuthology.orchestra.run.smithi026.stdout: "check_on_raw": false, 2020-04-28T12:55:06.158 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size": -1, 2020-04-28T12:55:06.158 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size_kb": 0, 2020-04-28T12:55:06.158 INFO:teuthology.orchestra.run.smithi026.stdout: "max_objects": -1 2020-04-28T12:55:06.158 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2020-04-28T12:55:06.159 INFO:teuthology.orchestra.run.smithi026.stdout: "user_quota": { 2020-04-28T12:55:06.159 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": false, 2020-04-28T12:55:06.159 INFO:teuthology.orchestra.run.smithi026.stdout: "check_on_raw": false, 2020-04-28T12:55:06.159 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size": -1, 2020-04-28T12:55:06.159 INFO:teuthology.orchestra.run.smithi026.stdout: "max_size_kb": 0, 2020-04-28T12:55:06.159 INFO:teuthology.orchestra.run.smithi026.stdout: "max_objects": -1 2020-04-28T12:55:06.159 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2020-04-28T12:55:06.160 INFO:teuthology.orchestra.run.smithi026.stdout: "temp_url_keys": [], 2020-04-28T12:55:06.160 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "rgw", 2020-04-28T12:55:06.160 INFO:teuthology.orchestra.run.smithi026.stdout: "mfa_ids": [] 2020-04-28T12:55:06.160 INFO:teuthology.orchestra.run.smithi026.stdout:} 2020-04-28T12:55:06.160 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:06.161 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.150+0000 7faadb534180 20 remove_watcher() i=0 2020-04-28T12:55:06.161 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.150+0000 7faadb534180 2 removed watcher, disabling cache 2020-04-28T12:55:06.161 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.152+0000 7faadb534180 20 remove_watcher() i=1 2020-04-28T12:55:06.161 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.153+0000 7faadb534180 20 remove_watcher() i=2 2020-04-28T12:55:06.161 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.155+0000 7faadb534180 20 remove_watcher() i=3 2020-04-28T12:55:06.162 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.156+0000 7faadb534180 20 remove_watcher() i=4 2020-04-28T12:55:06.162 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.157+0000 7faadb534180 20 remove_watcher() i=5 2020-04-28T12:55:06.163 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.159+0000 7faadb534180 20 remove_watcher() i=6 2020-04-28T12:55:06.164 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.160+0000 7faadb534180 20 remove_watcher() i=7 2020-04-28T12:55:06.171 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:55:06.184 INFO:teuthology.orchestra.run.smithi026:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2020-04-28T12:55:06.274 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2020-04-28T12:55:06.275 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:55:06.323 INFO:teuthology.orchestra.run.smithi026:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2020-04-28T12:55:06.383 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:55:06.437 INFO:teuthology.orchestra.run.smithi026:> radosgw-admin gc process --include-all 2020-04-28T12:55:06.516 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.511+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.517 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.513+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.517 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.513+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.518 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.514+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.518 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.514+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.519 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.514+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.519 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.514+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.520 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.515+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.540 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.531+0000 7fe975089180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:55:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.531+0000 7fe975089180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:55:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.531+0000 7fe975089180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:55:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.531+0000 7fe975089180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:55:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.531+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.541 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.532+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.532+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.532+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:55:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.532+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.533+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.533+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.533+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:55:06.542 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.533+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.534+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.534+0000 7fe975089180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:55:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.534+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.534+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.534+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.543 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.535+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.535+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.535+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:55:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.535+0000 7fe975089180 20 zonegroup default 2020-04-28T12:55:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.535+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.536+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.544 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.536+0000 7fe975089180 10 Cannot find current period zone using local zone 2020-04-28T12:55:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.536+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.536+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.545 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.536+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.549 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.536+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:06.549 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.536+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.549 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.537+0000 7fe975089180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:55:06.549 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.537+0000 7fe975089180 20 zone default found 2020-04-28T12:55:06.549 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.537+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.549 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.537+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.550 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.537+0000 7fe975089180 20 rados->read ofs=0 len=0 2020-04-28T12:55:06.550 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.538+0000 7fe975089180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:06.550 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.538+0000 7fe975089180 20 started sync module instance, tier type = 2020-04-28T12:55:06.550 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.538+0000 7fe975089180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:55:06.550 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.542+0000 7fe963873700 0 -- 172.21.15.26:0/1480098622 >> [v2:172.21.15.107:6826/23539,v1:172.21.15.107:6827/23539] conn(0x7fe94c0027d0 msgr2=0x7fe94c0010e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:55:06.558 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.553+0000 7fe975089180 20 add_watcher() i=0 2020-04-28T12:55:06.558 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.553+0000 7fe975089180 20 add_watcher() i=1 2020-04-28T12:55:06.558 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.553+0000 7fe975089180 20 add_watcher() i=2 2020-04-28T12:55:06.558 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.553+0000 7fe975089180 20 add_watcher() i=3 2020-04-28T12:55:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.553+0000 7fe975089180 20 add_watcher() i=4 2020-04-28T12:55:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.553+0000 7fe975089180 20 add_watcher() i=5 2020-04-28T12:55:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.553+0000 7fe975089180 20 add_watcher() i=6 2020-04-28T12:55:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.554+0000 7fe975089180 20 add_watcher() i=7 2020-04-28T12:55:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.554+0000 7fe975089180 2 all 8 watchers are set, enabling cache 2020-04-28T12:55:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.555+0000 7fe975089180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:55:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.555+0000 7fe975089180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:55:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.555+0000 7fe933fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:55:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.556+0000 7fe963873700 0 -- 172.21.15.26:0/1386252347 >> v1:172.21.15.26:6789/0 conn(0x5640966b1460 legacy=0x5640966a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:55:06.614 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.609+0000 7fe8a27fc700 20 reqs_thread_entry: start 2020-04-28T12:55:06.614 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.609+0000 7fe89bfff700 20 reqs_thread_entry: start 2020-04-28T12:55:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.609+0000 7fe975089180 20 init_complete bucket index max shards: 1999 2020-04-28T12:55:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.609+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T12:55:06.615 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.609+0000 7fe89a7fc700 20 reqs_thread_entry: start 2020-04-28T12:55:06.616 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.611+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.616 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.612+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.617 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.613+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.618 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.614+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T12:55:06.620 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.616+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.621 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.616+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.621 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.617+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.622 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.618+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T12:55:06.624 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.620+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.625 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.621+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.626 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.621+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.626 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.621+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.224', time=2020-04-28T14:54:36.160630+0000, chain.objs.size()=3 2020-04-28T12:55:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.621+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-FROZEN.2~9GWcoSzc5q5VFLjK7ZCHEWdI9JwkVPe.1 2020-04-28T12:55:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.622+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-FROZEN.2~9GWcoSzc5q5VFLjK7ZCHEWdI9JwkVPe.2 2020-04-28T12:55:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.622+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-FROZEN.2~9GWcoSzc5q5VFLjK7ZCHEWdI9JwkVPe.3 2020-04-28T12:55:06.628 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.624+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.631 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.627+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T12:55:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.629+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.634 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.630+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.630+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.635 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.630+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.20', time=2020-04-28T14:54:27.165806+0000, chain.objs.size()=4 2020-04-28T12:55:06.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.630+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2__multipart_foo.2~svv5La6Fhy-vEUtuN-bb5eF_cRDgqrL.1 2020-04-28T12:55:06.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.630+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2__multipart_foo.2~svv5La6Fhy-vEUtuN-bb5eF_cRDgqrL.2 2020-04-28T12:55:06.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.630+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2__multipart_foo.2~svv5La6Fhy-vEUtuN-bb5eF_cRDgqrL.3 2020-04-28T12:55:06.636 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.630+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.2__multipart_foo.2~svv5La6Fhy-vEUtuN-bb5eF_cRDgqrL.4 2020-04-28T12:55:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.633+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.636+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T12:55:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.638+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.639+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.639+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.640+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T12:55:06.646 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.642+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.643+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.643+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.645+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T12:55:06.651 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.647+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.652 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.647+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.652 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.648+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.648+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.210', time=2020-04-28T14:54:38.017933+0000, chain.objs.size()=3 2020-04-28T12:55:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.648+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-STANDARD.2~scT7_IcLjXw6asGXp7LFx3fGP5vSGFK.1 2020-04-28T12:55:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.648+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-STANDARD.2~scT7_IcLjXw6asGXp7LFx3fGP5vSGFK.2 2020-04-28T12:55:06.653 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.648+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-STANDARD.2~scT7_IcLjXw6asGXp7LFx3fGP5vSGFK.3 2020-04-28T12:55:06.656 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.651+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.659 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.654+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T12:55:06.661 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.656+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.662 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.657+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.658+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:55:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.658+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.112', time=2020-04-28T14:54:34.330263+0000, chain.objs.size()=1 2020-04-28T12:55:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.658+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.txQtsCbX1kEdgGUSgOj3BvjK0XZvRN2_0 2020-04-28T12:55:06.663 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.658+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.114', time=2020-04-28T14:54:34.336344+0000, chain.objs.size()=1 2020-04-28T12:55:06.664 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.658+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.txQtsCbX1kEdgGUSgOj3BvjK0XZvRN2_0 2020-04-28T12:55:06.666 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.661+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.668 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.664+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T12:55:06.670 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.666+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.671 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.667+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.672 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.667+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.673 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.669+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T12:55:06.675 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.671+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.671+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.676 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.672+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.672+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.242', time=2020-04-28T14:54:36.198135+0000, chain.objs.size()=3 2020-04-28T12:55:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.672+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-STANDARD.2~f7vDpMgfVdIbgP4J38FPbe0SVA_UL5X.1 2020-04-28T12:55:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.672+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-STANDARD.2~f7vDpMgfVdIbgP4J38FPbe0SVA_UL5X.2 2020-04-28T12:55:06.677 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.672+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-STANDARD.2~f7vDpMgfVdIbgP4J38FPbe0SVA_UL5X.3 2020-04-28T12:55:06.679 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.675+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.682 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.678+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T12:55:06.684 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.680+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.685 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.681+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.681+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.686 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.681+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.40', time=2020-04-28T14:54:28.915012+0000, chain.objs.size()=4 2020-04-28T12:55:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.681+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3__multipart_foo.2~pR0mDbaamRgNCJwHUSGetolbOg21P3w.1 2020-04-28T12:55:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.681+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3__multipart_foo.2~pR0mDbaamRgNCJwHUSGetolbOg21P3w.2 2020-04-28T12:55:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.681+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3__multipart_foo.2~pR0mDbaamRgNCJwHUSGetolbOg21P3w.3 2020-04-28T12:55:06.687 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.681+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.3__multipart_foo.2~pR0mDbaamRgNCJwHUSGetolbOg21P3w.4 2020-04-28T12:55:06.689 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.684+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.691 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.687+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T12:55:06.693 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.689+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.694 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.690+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.690+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.690+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_I2QeUMFR-v4RhAP5r1yyBYSKjinyzvr', time=2020-04-28T14:54:36.179014+0000, chain.objs.size()=2 2020-04-28T12:55:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.690+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.uedN62UETbqtpkTtm4ke-jNATsqLdLi_1 2020-04-28T12:55:06.695 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.690+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.uedN62UETbqtpkTtm4ke-jNATsqLdLi_2 2020-04-28T12:55:06.696 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.692+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.700 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.695+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T12:55:06.701 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.697+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.702 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.698+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.702 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.698+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.703 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.698+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.109', time=2020-04-28T14:54:34.399106+0000, chain.objs.size()=1 2020-04-28T12:55:06.703 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.698+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.jh3d42CFS6aur9ML2wdv_xJYsnwOMWv_0 2020-04-28T12:55:06.704 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.699+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.707 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.702+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T12:55:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.704+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.705+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.710 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.706+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.712 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.707+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T12:55:06.713 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.709+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.714 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.710+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.714 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.710+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2020-04-28T12:55:06.715 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.710+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_j-omdDU0GfnkU7snRIrxMIB6z_5cmu7', time=2020-04-28T14:54:34.379651+0000, chain.objs.size()=1 2020-04-28T12:55:06.715 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.710+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.zPP58WRmWJWeq83xoVGBUTeENB0xBoi_0 2020-04-28T12:55:06.715 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.710+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.84', time=2020-04-28T14:54:39.713069+0000, chain.objs.size()=2 2020-04-28T12:55:06.715 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.710+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6__shadow_.j46WYJv9maPXmNY9PMux5x7quo-RMOU_0 2020-04-28T12:55:06.715 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.710+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6__shadow_.j46WYJv9maPXmNY9PMux5x7quo-RMOU_1 2020-04-28T12:55:06.718 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.713+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.721 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.716+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T12:55:06.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.718+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.725 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.719+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.726 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.720+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.726 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.721+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T12:55:06.727 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.723+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.724+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.724+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.724+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.203', time=2020-04-28T14:54:38.004340+0000, chain.objs.size()=3 2020-04-28T12:55:06.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.724+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-LUKEWARM.2~iJF68zh5umhqJe1jk-9-2Y_4DS18hxP.1 2020-04-28T12:55:06.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.724+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-LUKEWARM.2~iJF68zh5umhqJe1jk-9-2Y_4DS18hxP.2 2020-04-28T12:55:06.730 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.724+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-LUKEWARM.2~iJF68zh5umhqJe1jk-9-2Y_4DS18hxP.3 2020-04-28T12:55:06.731 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.726+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.734 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.729+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T12:55:06.736 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.731+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.736 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.732+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.737 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.733+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.738 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.734+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T12:55:06.740 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.736+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.741 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.737+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.737+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.737+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.225', time=2020-04-28T14:54:36.210789+0000, chain.objs.size()=3 2020-04-28T12:55:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.737+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-FROZEN.2~9GWcoSzc5q5VFLjK7ZCHEWdI9JwkVPe.1 2020-04-28T12:55:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.737+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-FROZEN.2~9GWcoSzc5q5VFLjK7ZCHEWdI9JwkVPe.2 2020-04-28T12:55:06.742 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.737+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-FROZEN.2~9GWcoSzc5q5VFLjK7ZCHEWdI9JwkVPe.3 2020-04-28T12:55:06.744 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.740+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.747 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.742+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T12:55:06.749 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.744+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.750 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.745+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.751 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.746+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.751 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.746+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.235', time=2020-04-28T14:54:36.147529+0000, chain.objs.size()=3 2020-04-28T12:55:06.751 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.746+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-LUKEWARM.2~NxVE0D6eDvXfH-NDklDe2YH7diG8qTB.1 2020-04-28T12:55:06.751 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.746+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-LUKEWARM.2~NxVE0D6eDvXfH-NDklDe2YH7diG8qTB.2 2020-04-28T12:55:06.751 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.746+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-LUKEWARM.2~NxVE0D6eDvXfH-NDklDe2YH7diG8qTB.3 2020-04-28T12:55:06.752 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.747+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.754 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.750+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T12:55:06.757 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.753+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.758 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.759 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T12:55:06.759 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_m9kI8Yk40rSfDe6djkC_vbVlXfm4WGM', time=2020-04-28T14:54:34.354648+0000, chain.objs.size()=1 2020-04-28T12:55:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.mADYvE9tg_znxGzDcAIaFNruRTfvP_4_0 2020-04-28T12:55:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.245', time=2020-04-28T14:54:36.185396+0000, chain.objs.size()=3 2020-04-28T12:55:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-STANDARD.2~f7vDpMgfVdIbgP4J38FPbe0SVA_UL5X.1 2020-04-28T12:55:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-STANDARD.2~f7vDpMgfVdIbgP4J38FPbe0SVA_UL5X.2 2020-04-28T12:55:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-STANDARD.2~f7vDpMgfVdIbgP4J38FPbe0SVA_UL5X.3 2020-04-28T12:55:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.196', time=2020-04-28T14:54:38.010877+0000, chain.objs.size()=3 2020-04-28T12:55:06.760 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-FROZEN.2~tb1wDFv7CzMJKWVBXt92N9mmGFtbQNi.1 2020-04-28T12:55:06.761 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-FROZEN.2~tb1wDFv7CzMJKWVBXt92N9mmGFtbQNi.2 2020-04-28T12:55:06.761 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.754+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.8__multipart_foo-FROZEN.2~tb1wDFv7CzMJKWVBXt92N9mmGFtbQNi.3 2020-04-28T12:55:06.763 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.758+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.766 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.761+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T12:55:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.763+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.768 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.764+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.765+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.765+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_CSyXtMorh7v9QyeBYVWgMF2gGomSyut', time=2020-04-28T14:54:34.369175+0000, chain.objs.size()=1 2020-04-28T12:55:06.769 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.765+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.w0vPzYdObv2laO-ehBYXY7WIQPPXvAQ_1 2020-04-28T12:55:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.766+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.774 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.769+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T12:55:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.771+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.772+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.772+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.772+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.55', time=2020-04-28T14:54:30.635075+0000, chain.objs.size()=4 2020-04-28T12:55:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.772+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4__multipart_foo.2~XJ4D_s-kvU_Yeu9x_YGbsTSv2fyJgPp.1 2020-04-28T12:55:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.772+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4__multipart_foo.2~XJ4D_s-kvU_Yeu9x_YGbsTSv2fyJgPp.2 2020-04-28T12:55:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.772+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4__multipart_foo.2~XJ4D_s-kvU_Yeu9x_YGbsTSv2fyJgPp.3 2020-04-28T12:55:06.778 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.772+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.4__multipart_foo.2~XJ4D_s-kvU_Yeu9x_YGbsTSv2fyJgPp.4 2020-04-28T12:55:06.780 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.775+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.779+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T12:55:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.781+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.781+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.782+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.782+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_USItv9yFHxHbaFMDUhIm92DMv6Sc-54', time=2020-04-28T14:54:36.166773+0000, chain.objs.size()=2 2020-04-28T12:55:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.782+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.vFubw5ikTtxLRAlCvShHTwHnlIaenLx_0 2020-04-28T12:55:06.787 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.782+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.vFubw5ikTtxLRAlCvShHTwHnlIaenLx_1 2020-04-28T12:55:06.788 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.784+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.791 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.787+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T12:55:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.788+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.793 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.789+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.794 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2020-04-28T12:55:06.794 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.233', time=2020-04-28T14:54:36.141181+0000, chain.objs.size()=3 2020-04-28T12:55:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-LUKEWARM.2~NxVE0D6eDvXfH-NDklDe2YH7diG8qTB.1 2020-04-28T12:55:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-LUKEWARM.2~NxVE0D6eDvXfH-NDklDe2YH7diG8qTB.2 2020-04-28T12:55:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__multipart_foo-LUKEWARM.2~NxVE0D6eDvXfH-NDklDe2YH7diG8qTB.3 2020-04-28T12:55:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_CHnsenF6KoXAsAZoZTnPjZs7Yff-HN3', time=2020-04-28T14:54:36.154013+0000, chain.objs.size()=2 2020-04-28T12:55:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.NP_vl5fn4ZRjxLi9880VK5reTVzx5Ca_1 2020-04-28T12:55:06.795 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.NP_vl5fn4ZRjxLi9880VK5reTVzx5Ca_2 2020-04-28T12:55:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_X6uTmL0f7qSfP7Az0xRSoYOH5G6S8mV', time=2020-04-28T14:54:36.191881+0000, chain.objs.size()=2 2020-04-28T12:55:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.7FBm8vtaJP1CuEQBX8J9MvYK4_FkbsS_0 2020-04-28T12:55:06.796 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.790+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.7FBm8vtaJP1CuEQBX8J9MvYK4_FkbsS_1 2020-04-28T12:55:06.799 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.794+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.802 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.798+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T12:55:06.804 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.799+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.805 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.800+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.805 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.801+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.801+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_PCWjuZdeOaovfmz8uLk6tfkmRgSdeHU', time=2020-04-28T14:54:34.391301+0000, chain.objs.size()=1 2020-04-28T12:55:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.801+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.EZ0v3H1JGpHhGDcGrN_yY7qEGTYDBkZ_0 2020-04-28T12:55:06.806 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.802+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.809 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.805+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T12:55:06.811 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.807+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.807+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.812 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.808+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.808+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_bm16JxxCE8Q7YonaqBam316X9-YXlnY', time=2020-04-28T14:54:36.172803+0000, chain.objs.size()=2 2020-04-28T12:55:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.808+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.du3JLLlqzSRMFoMLMvf3Ze1p5OJr0m8_0 2020-04-28T12:55:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.808+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.du3JLLlqzSRMFoMLMvf3Ze1p5OJr0m8_1 2020-04-28T12:55:06.815 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.811+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.818 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.813+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T12:55:06.819 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.815+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.820 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.816+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.821 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.816+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.822 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.818+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T12:55:06.824 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.819+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.824 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.820+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.825 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.820+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.825 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.820+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.108', time=2020-04-28T14:54:34.348535+0000, chain.objs.size()=1 2020-04-28T12:55:06.825 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.820+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.jh3d42CFS6aur9ML2wdv_xJYsnwOMWv_0 2020-04-28T12:55:06.827 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.823+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.830 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.826+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T12:55:06.832 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.827+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.833 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.828+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.829+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2020-04-28T12:55:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.829+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.71', time=2020-04-28T14:54:32.385986+0000, chain.objs.size()=4 2020-04-28T12:55:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.829+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5__multipart_foo.2~WgfpKGaq3ylYWMF0QT0X7uG3Odd2p28.1 2020-04-28T12:55:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.829+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5__multipart_foo.2~WgfpKGaq3ylYWMF0QT0X7uG3Odd2p28.2 2020-04-28T12:55:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.829+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5__multipart_foo.2~WgfpKGaq3ylYWMF0QT0X7uG3Odd2p28.3 2020-04-28T12:55:06.834 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.829+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.5__multipart_foo.2~WgfpKGaq3ylYWMF0QT0X7uG3Odd2p28.4 2020-04-28T12:55:06.837 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.832+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.840 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.835+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T12:55:06.842 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.837+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.843 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2020-04-28T12:55:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_HgmXlmFU_qBnjVRDhQffrQf0Y0hReNO', time=2020-04-28T14:54:34.342185+0000, chain.objs.size()=1 2020-04-28T12:55:06.845 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.LnOn-RLi1Ad7WZ6Cn_xOTeUEZelk2is_1 2020-04-28T12:55:06.845 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_j3aJpd96Wv1GD7fmo38IMvhRfYv1FtE', time=2020-04-28T14:54:34.361770+0000, chain.objs.size()=1 2020-04-28T12:55:06.845 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.7__shadow_.dfz0GyX_GvC2lwdbF5CJChEYAATLnaS_0 2020-04-28T12:55:06.845 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='_O536msUxOA7h49_he2tZZ3PHCmkJImy', time=2020-04-28T14:54:36.204476+0000, chain.objs.size()=2 2020-04-28T12:55:06.845 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.839+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.rQF6OPioJw28P_FQ1k0J3ySnl5NPORS_0 2020-04-28T12:55:06.846 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.840+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.9__shadow_.rQF6OPioJw28P_FQ1k0J3ySnl5NPORS_1 2020-04-28T12:55:06.846 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.840+0000 7fe975089180 20 garbage collection: RGWGC::process iterating over entry tag='5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4620.85', time=2020-04-28T14:54:39.706399+0000, chain.objs.size()=2 2020-04-28T12:55:06.846 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.840+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6__shadow_.cgrjka5UM2LIFxY5_1HJOCIp_7dh7SO_0 2020-04-28T12:55:06.846 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.840+0000 7fe975089180 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:5e5c3d59-d3fa-462a-b634-39ba26dcbd1e.4388.6__shadow_.cgrjka5UM2LIFxY5_1HJOCIp_7dh7SO_1 2020-04-28T12:55:06.848 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.844+0000 7fe975089180 5 garbage collection: RGWGC::process removing entries, marker: 2020-04-28T12:55:06.851 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.847+0000 7fe975089180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T12:55:06.853 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.848+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.854 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.849+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:06.854 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.850+0000 7fe975089180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:06.855 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.851+0000 7fe933fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:55:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.853+0000 7fe975089180 20 remove_watcher() i=0 2020-04-28T12:55:06.857 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.853+0000 7fe975089180 2 removed watcher, disabling cache 2020-04-28T12:55:06.859 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.854+0000 7fe975089180 20 remove_watcher() i=1 2020-04-28T12:55:06.860 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.856+0000 7fe975089180 20 remove_watcher() i=2 2020-04-28T12:55:06.861 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.857+0000 7fe975089180 20 remove_watcher() i=3 2020-04-28T12:55:06.863 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.858+0000 7fe975089180 20 remove_watcher() i=4 2020-04-28T12:55:06.864 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.860+0000 7fe975089180 20 remove_watcher() i=5 2020-04-28T12:55:06.865 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.861+0000 7fe975089180 20 remove_watcher() i=6 2020-04-28T12:55:06.867 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:06.862+0000 7fe975089180 20 remove_watcher() i=7 2020-04-28T12:55:06.871 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:55:06.925 INFO:teuthology.orchestra.run.smithi026:> radosgw-admin gc process --include-all 2020-04-28T12:55:07.005 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.000+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.006 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.002+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.002+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.007 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.003+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.003+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.003+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.003+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.008 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.004+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:07.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.019+0000 7f0145934180 20 RGWRados::pool_iterate: got zonegroup_info.eae1542a-d71a-4f0a-a6d0-6f25f5bb8c8f 2020-04-28T12:55:07.024 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.019+0000 7f0145934180 20 RGWRados::pool_iterate: got zone_info.5e5c3d59-d3fa-462a-b634-39ba26dcbd1e 2020-04-28T12:55:07.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.019+0000 7f0145934180 20 RGWRados::pool_iterate: got zone_names.default 2020-04-28T12:55:07.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.019+0000 7f0145934180 20 RGWRados::pool_iterate: got zonegroups_names.default 2020-04-28T12:55:07.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.019+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.020+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:07.025 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.020+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.026 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.020+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:55:07.026 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.020+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.026 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.021+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:07.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.021+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.021+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:55:07.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.021+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.022+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.022+0000 7f0145934180 10 cannot find current period zonegroup using local zonegroup 2020-04-28T12:55:07.027 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.022+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.022+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.022+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.028 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.022+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:07.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.022+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.023+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=392 2020-04-28T12:55:07.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.023+0000 7f0145934180 20 zonegroup default 2020-04-28T12:55:07.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.023+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.023+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.023+0000 7f0145934180 10 Cannot find current period zone using local zone 2020-04-28T12:55:07.029 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.023+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.024+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.030 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.024+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.024+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=46 2020-04-28T12:55:07.033 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.024+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.024+0000 7f0145934180 20 rados_obj.operate() r=0 bl.length=951 2020-04-28T12:55:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.024+0000 7f0145934180 20 zone default found 2020-04-28T12:55:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.024+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.025+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.025+0000 7f0145934180 20 rados->read ofs=0 len=0 2020-04-28T12:55:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.025+0000 7f0145934180 20 rados_obj.operate() r=-2 bl.length=0 2020-04-28T12:55:07.034 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.025+0000 7f0145934180 20 started sync module instance, tier type = 2020-04-28T12:55:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.025+0000 7f0145934180 20 started zone id=5e5c3d59-d3fa-462a-b634-39ba26dcbd1e (name=default) with tier type = 2020-04-28T12:55:07.035 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.029+0000 7f013311c700 0 -- 172.21.15.26:0/2180403670 >> [v2:172.21.15.107:6810/23470,v1:172.21.15.107:6811/23470] conn(0x563e132ffdb0 msgr2=0x563e13302230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:55:07.052 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.037+0000 7f0145934180 20 add_watcher() i=0 2020-04-28T12:55:07.053 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.037+0000 7f0145934180 20 add_watcher() i=1 2020-04-28T12:55:07.053 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.037+0000 7f0145934180 20 add_watcher() i=2 2020-04-28T12:55:07.053 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.037+0000 7f0145934180 20 add_watcher() i=3 2020-04-28T12:55:07.053 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.037+0000 7f0145934180 20 add_watcher() i=4 2020-04-28T12:55:07.053 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.037+0000 7f0145934180 20 add_watcher() i=5 2020-04-28T12:55:07.054 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.037+0000 7f0145934180 20 add_watcher() i=6 2020-04-28T12:55:07.054 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.038+0000 7f0145934180 20 add_watcher() i=7 2020-04-28T12:55:07.054 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.038+0000 7f0145934180 2 all 8 watchers are set, enabling cache 2020-04-28T12:55:07.054 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.038+0000 7f0145934180 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2020-04-28T12:55:07.054 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.038+0000 7f0145934180 20 check_secure_mon_conn(): mode 1 is insecure 2020-04-28T12:55:07.054 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.039+0000 7f0087fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:55:07.055 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.040+0000 7f013391d700 0 -- 172.21.15.26:0/1822817325 >> v1:172.21.15.26:6789/0 conn(0x563e1330f440 legacy=0x563e1334b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2020-04-28T12:55:07.093 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.088+0000 7f00727fc700 20 reqs_thread_entry: start 2020-04-28T12:55:07.094 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.089+0000 7f006bfff700 20 reqs_thread_entry: start 2020-04-28T12:55:07.094 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.089+0000 7f0145934180 20 init_complete bucket index max shards: 1999 2020-04-28T12:55:07.094 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.089+0000 7f006a7fc700 20 reqs_thread_entry: start 2020-04-28T12:55:07.094 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.089+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2020-04-28T12:55:07.095 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.091+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.096 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.092+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.096 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.092+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.098 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.094+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2020-04-28T12:55:07.100 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.095+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.101 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.096+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.102 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.097+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.103 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.099+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2020-04-28T12:55:07.105 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.100+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.101+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.106 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.102+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.103+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2020-04-28T12:55:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.105+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.106+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.111 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.106+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.112 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.108+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2020-04-28T12:55:07.114 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.110+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.115 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.111+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.116 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.111+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.118 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.113+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2020-04-28T12:55:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.115+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.116+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.116+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.117+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2020-04-28T12:55:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.119+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.124 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.120+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.124 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.120+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.126 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.122+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2020-04-28T12:55:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.124+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.125+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.130 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.125+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.131 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.127+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2020-04-28T12:55:07.133 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.128+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.133 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.129+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.134 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.130+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.131+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2020-04-28T12:55:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.133+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.134+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.134+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.136+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2020-04-28T12:55:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.138+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.139+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.144 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.139+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.145 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.141+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2020-04-28T12:55:07.147 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.143+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.143+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.148 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.144+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.149 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.145+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2020-04-28T12:55:07.152 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.148+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.155 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.149+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.155 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.149+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.156 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.150+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2020-04-28T12:55:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.152+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.153+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.154+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.160 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.155+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2020-04-28T12:55:07.161 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.157+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.158+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.158+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.160+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2020-04-28T12:55:07.166 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.161+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.167 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.162+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.167 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.163+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.164+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2020-04-28T12:55:07.171 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.166+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.167+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.172 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.168+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.174 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.169+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2020-04-28T12:55:07.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.171+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.176 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.172+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.177 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.172+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.178 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.174+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2020-04-28T12:55:07.180 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.176+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.181 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.177+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.182 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.177+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.183 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.179+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2020-04-28T12:55:07.185 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.181+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.186 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.182+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.187 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.182+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.188 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.183+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2020-04-28T12:55:07.190 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.185+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.191 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.186+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.191 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.187+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.193 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.188+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2020-04-28T12:55:07.195 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.190+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.191+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.196 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.192+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.197 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.193+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2020-04-28T12:55:07.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.195+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.201 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.196+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.202 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.197+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.202 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.198+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2020-04-28T12:55:07.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.200+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.205 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.201+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.206 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.202+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.207 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.203+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2020-04-28T12:55:07.209 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.205+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.206+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.210 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.206+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.212 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.207+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2020-04-28T12:55:07.214 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.210+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.215 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.211+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.216 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.211+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.217 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.213+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2020-04-28T12:55:07.219 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.215+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.216+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.220 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.216+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.222 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.217+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2020-04-28T12:55:07.223 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.219+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.224 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.220+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.225 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.220+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.226 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.222+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2020-04-28T12:55:07.228 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.224+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.229 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.225+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.230 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.226+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.231 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.227+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2020-04-28T12:55:07.233 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.229+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.229+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.234 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.230+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.235 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.231+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2020-04-28T12:55:07.237 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.233+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.233+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.238 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.234+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.239 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.235+0000 7f0145934180 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2020-04-28T12:55:07.241 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.237+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.242 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.238+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2020-04-28T12:55:07.243 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.238+0000 7f0145934180 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2020-04-28T12:55:07.245 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.240+0000 7f0087fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-04-28T12:55:07.246 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.242+0000 7f0145934180 20 remove_watcher() i=0 2020-04-28T12:55:07.246 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.242+0000 7f0145934180 2 removed watcher, disabling cache 2020-04-28T12:55:07.248 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.243+0000 7f0145934180 20 remove_watcher() i=1 2020-04-28T12:55:07.249 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.244+0000 7f0145934180 20 remove_watcher() i=2 2020-04-28T12:55:07.250 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.246+0000 7f0145934180 20 remove_watcher() i=3 2020-04-28T12:55:07.252 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.247+0000 7f0145934180 20 remove_watcher() i=4 2020-04-28T12:55:07.253 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.249+0000 7f0145934180 20 remove_watcher() i=5 2020-04-28T12:55:07.255 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.250+0000 7f0145934180 20 remove_watcher() i=6 2020-04-28T12:55:07.256 INFO:teuthology.orchestra.run.smithi026.stderr:2020-04-28T12:55:07.252+0000 7f0145934180 20 remove_watcher() i=7 2020-04-28T12:55:07.260 INFO:teuthology.orchestra.run.smithi026:> true 2020-04-28T12:55:07.314 INFO:teuthology.orchestra.run.smithi026:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2020-04-28T12:55:07.822 INFO:teuthology.orchestra.run.smithi026.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2020-04-28T12:55:11.722 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :clean UP-TO-DATE 2020-04-28T12:55:28.821 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :compileJava 2020-04-28T12:55:28.822 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :processResources 2020-04-28T12:55:28.822 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :classes 2020-04-28T12:55:29.422 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:29.423 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :compileTestJava 2020-04-28T12:55:29.423 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:29.423 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :processTestResources NO-SOURCE 2020-04-28T12:55:29.423 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :testClasses 2020-04-28T12:55:29.423 INFO:teuthology.orchestra.run.smithi026.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2020-04-28T12:55:29.424 INFO:teuthology.orchestra.run.smithi026.stderr:Note: Recompile with -Xlint:deprecation for details. 2020-04-28T12:55:35.622 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:35.622 INFO:teuthology.orchestra.run.smithi026.stdout:> Task :test 2020-04-28T12:55:35.622 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:35.622 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2020-04-28T12:55:36.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:36.821 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2020-04-28T12:55:38.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:38.822 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2020-04-28T12:55:39.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:39.322 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2020-04-28T12:55:41.322 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:41.322 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2020-04-28T12:55:42.524 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:42.524 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2020-04-28T12:55:44.521 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:44.522 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T12:55:44.522 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:44.522 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T12:55:44.621 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:44.621 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2020-04-28T12:55:45.121 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:45.121 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2020-04-28T12:55:47.121 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:47.121 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2020-04-28T12:55:48.421 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:48.421 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2020-04-28T12:55:52.521 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:52.521 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2020-04-28T12:55:57.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:55:57.021 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2020-04-28T12:56:01.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:01.022 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2020-04-28T12:56:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:01.422 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2020-04-28T12:56:03.622 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:03.622 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2020-04-28T12:56:04.521 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:04.522 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2020-04-28T12:56:08.621 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:08.621 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2020-04-28T12:56:09.722 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:09.722 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2020-04-28T12:56:11.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:11.822 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2020-04-28T12:56:11.822 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:11.822 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2020-04-28T12:56:11.921 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:11.921 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2020-04-28T12:56:14.821 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:14.821 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2020-04-28T12:56:17.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:17.021 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2020-04-28T12:56:18.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:18.123 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2020-04-28T12:56:20.429 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:20.429 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2020-04-28T12:56:21.124 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:21.124 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2020-04-28T12:56:23.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:23.221 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2020-04-28T12:56:32.221 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:32.222 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2020-04-28T12:56:34.228 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:34.228 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2020-04-28T12:56:36.024 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:36.024 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2020-04-28T12:56:38.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:38.322 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2020-04-28T12:56:39.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:39.322 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2020-04-28T12:56:41.321 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:41.321 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2020-04-28T12:56:42.122 INFO:teuthology.orchestra.run.smithi026.stdout: 2020-04-28T12:56:42.122 INFO:teuthology.orchestra.run.smithi026.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2020-04-28T12:57:08.843 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T12:57:08.836+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T12:57:40.209 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T12:57:40.204+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T12:59:38.793 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T12:59:38.788+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:00:04.123 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T13:00:04.119+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T13:00:17.438 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:00:17.429+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:00:53.143 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:00:53.137+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:01:44.950 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:01:44.940+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:01:55.787 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T13:01:55.781+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T13:02:03.166 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T13:02:03.162+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T13:02:49.471 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:02:49.466+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T13:02:49.471 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:02:49.466+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T13:03:52.294 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:03:52.290+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:04:28.095 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T13:04:28.092+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T13:05:32.540 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:05:32.534+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T13:05:32.540 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:05:32.534+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T13:05:33.803 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:05:33.798+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T13:05:33.804 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:05:33.798+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T13:07:31.450 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:07:31.446+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:13:59.565 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:13:59.558+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T13:13:59.566 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:13:59.558+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T13:14:09.975 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:14:09.972+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:14:42.851 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:14:42.845+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:15:15.082 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T13:15:15.080+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T13:18:42.654 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T13:18:42.653+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T13:18:59.358 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T13:18:59.356+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T13:19:37.466 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:19:37.464+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:21:54.390 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:21:54.389+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:23:13.713 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T13:23:13.713+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T13:24:05.315 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:24:05.314+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:24:26.826 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:24:26.823+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T13:24:26.826 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:24:26.823+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T13:25:01.742 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:25:01.738+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T13:25:01.742 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:25:01.738+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T13:31:41.016 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T13:31:41.014+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T13:32:53.768 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:32:53.765+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:35:18.081 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:35:18.080+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T13:35:50.805 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T13:35:50.804+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T13:36:09.344 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:36:09.342+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:36:38.112 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:36:38.110+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T13:36:38.113 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:36:38.110+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T13:37:19.638 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:37:19.637+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T13:37:19.639 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:37:19.637+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T13:39:30.244 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:39:30.243+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:39:31.745 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:39:31.743+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T13:39:55.546 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:39:55.546+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T13:39:55.546 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T13:39:55.546+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T13:40:14.565 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T13:40:14.562+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T13:40:24.949 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:40:24.947+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:41:28.820 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:41:28.819+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:44:43.466 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T13:44:43.463+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T13:48:34.867 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:48:34.865+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T13:50:42.007 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T13:50:42.006+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T14:02:30.064 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T14:02:30.062+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T14:03:12.570 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:03:12.569+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T14:03:12.570 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:03:12.569+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T14:20:43.564 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:20:43.562+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T14:20:43.583 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:20:43.562+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T14:23:25.262 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:23:25.259+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T14:23:25.262 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:23:25.259+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T14:23:41.823 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:23:41.820+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T14:23:41.823 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:23:41.820+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T14:25:45.245 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T14:25:45.243+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T14:29:47.726 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:29:47.721+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T14:29:47.726 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:29:47.721+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T14:33:06.001 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T14:33:05.999+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T14:38:34.131 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T14:38:34.130+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T14:41:40.736 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T14:41:40.735+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T14:41:43.055 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T14:41:43.054+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T14:45:31.061 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T14:45:31.059+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T14:45:40.180 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T14:45:40.179+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T14:56:01.757 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T14:56:01.756+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T14:56:13.619 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:56:13.617+0000 7f75e7636700 -1 reset not still connected to 0x55bc52aefba0 2020-04-28T14:56:13.619 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:56:13.617+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T14:56:20.911 INFO:tasks.ceph.osd.4.smithi107.stderr:problem writing to /var/log/ceph/ceph-osd.4.log: (28) No space left on device 2020-04-28T14:56:20.911 INFO:tasks.ceph.osd.5.smithi107.stderr:problem writing to /var/log/ceph/ceph-osd.5.log: (28) No space left on device 2020-04-28T14:56:20.912 INFO:tasks.ceph.osd.7.smithi107.stderr:problem writing to /var/log/ceph/ceph-osd.7.log: (28) No space left on device 2020-04-28T14:56:20.912 INFO:tasks.ceph.osd.6.smithi107.stderr:problem writing to /var/log/ceph/ceph-osd.6.log: (28) No space left on device 2020-04-28T14:56:20.926 INFO:tasks.ceph.mgr.x.smithi107.stderr:problem writing to /var/log/ceph/ceph-mgr.x.log: (28) No space left on device 2020-04-28T14:56:21.012 INFO:tasks.ceph.mon.b.smithi107.stderr:problem writing to /var/log/ceph/ceph-mon.b.log: (28) No space left on device 2020-04-28T14:56:43.673 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:56:43.671+0000 7f75f0c71700 -1 osd.6 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:19.129146+0000 front 2020-04-28T14:56:19.129350+0000 (oldest deadline 2020-04-28T14:56:43.229208+0000) 2020-04-28T14:56:43.677 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T14:56:43.675+0000 7f39ff982700 -1 osd.5 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:17.877872+0000 front 2020-04-28T14:56:17.877931+0000 (oldest deadline 2020-04-28T14:56:43.177825+0000) 2020-04-28T14:56:43.993 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T14:56:43.992+0000 7f4675e4b700 -1 osd.2 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:18.363717+0000 front 2020-04-28T14:56:18.368240+0000 (oldest deadline 2020-04-28T14:56:43.063414+0000) 2020-04-28T14:56:44.633 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:56:44.632+0000 7f75f0c71700 -1 osd.6 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:19.129146+0000 front 2020-04-28T14:56:19.129350+0000 (oldest deadline 2020-04-28T14:56:43.229208+0000) 2020-04-28T14:56:44.665 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T14:56:44.663+0000 7f39ff982700 -1 osd.5 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:17.877872+0000 front 2020-04-28T14:56:17.877931+0000 (oldest deadline 2020-04-28T14:56:43.177825+0000) 2020-04-28T14:56:44.920 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T14:56:44.919+0000 7fd2b4b4b700 -1 osd.0 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:18.696084+0000 front 2020-04-28T14:56:18.696779+0000 (oldest deadline 2020-04-28T14:56:43.995065+0000) 2020-04-28T14:56:44.984 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T14:56:44.983+0000 7f4675e4b700 -1 osd.2 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:18.363717+0000 front 2020-04-28T14:56:18.368240+0000 (oldest deadline 2020-04-28T14:56:43.063414+0000) 2020-04-28T14:56:45.030 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T14:56:45.028+0000 7f0fecfbc700 -1 osd.7 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:18.386254+0000 front 2020-04-28T14:56:18.389380+0000 (oldest deadline 2020-04-28T14:56:44.285031+0000) 2020-04-28T14:56:45.459 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:56:45.458+0000 7f2be012c700 -1 osd.3 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:20.486808+0000 front 2020-04-28T14:56:20.486394+0000 (oldest deadline 2020-04-28T14:56:45.186142+0000) 2020-04-28T14:56:45.588 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T14:56:45.586+0000 7f75f0c71700 -1 osd.6 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:19.129146+0000 front 2020-04-28T14:56:19.129350+0000 (oldest deadline 2020-04-28T14:56:43.229208+0000) 2020-04-28T14:56:45.666 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T14:56:45.665+0000 7f39ff982700 -1 osd.5 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:17.877872+0000 front 2020-04-28T14:56:17.877931+0000 (oldest deadline 2020-04-28T14:56:43.177825+0000) 2020-04-28T14:56:45.888 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T14:56:45.887+0000 7fd2b4b4b700 -1 osd.0 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:18.696084+0000 front 2020-04-28T14:56:18.696779+0000 (oldest deadline 2020-04-28T14:56:43.995065+0000) 2020-04-28T14:56:45.979 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T14:56:45.977+0000 7f4675e4b700 -1 osd.2 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:18.363717+0000 front 2020-04-28T14:56:18.368240+0000 (oldest deadline 2020-04-28T14:56:43.063414+0000) 2020-04-28T14:56:46.065 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T14:56:46.064+0000 7f0fecfbc700 -1 osd.7 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:18.386254+0000 front 2020-04-28T14:56:18.389380+0000 (oldest deadline 2020-04-28T14:56:44.285031+0000) 2020-04-28T14:56:46.197 INFO:tasks.ceph.osd.1.smithi026.stderr:2020-04-28T14:56:46.195+0000 7f3c5d1c5700 -1 osd.1 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:19.543027+0000 front 2020-04-28T14:56:19.543913+0000 (oldest deadline 2020-04-28T14:56:45.443180+0000) 2020-04-28T14:56:46.469 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T14:56:46.467+0000 7f2be012c700 -1 osd.3 126 heartbeat_check: no reply from 172.21.15.107:6806 osd.4 since back 2020-04-28T14:56:20.486808+0000 front 2020-04-28T14:56:20.486394+0000 (oldest deadline 2020-04-28T14:56:45.186142+0000) 2020-04-28T14:59:23.722 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T14:59:23.719+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T14:59:36.500 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T14:59:36.490+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T15:01:01.227 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T15:01:01.224+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T15:03:01.092 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T15:03:01.090+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T15:03:18.136 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T15:03:18.134+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T15:03:52.099 INFO:tasks.ceph.osd.3.smithi026.stderr:problem writing to /var/log/ceph/ceph-osd.3.log: (28) No space left on device 2020-04-28T15:03:52.101 INFO:tasks.ceph.osd.0.smithi026.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2020-04-28T15:03:52.101 INFO:tasks.ceph.osd.1.smithi026.stderr:problem writing to /var/log/ceph/ceph-osd.1.log: (28) No space left on device 2020-04-28T15:03:52.102 INFO:tasks.ceph.osd.2.smithi026.stderr:problem writing to /var/log/ceph/ceph-osd.2.log: (28) No space left on device 2020-04-28T15:03:52.249 INFO:tasks.rgw.client.0.smithi026.stdout:problem writing to /var/log/ceph/rgw.ceph.client.0.log: (28) No space left on device 2020-04-28T15:03:52.717 INFO:tasks.ceph.mon.c.smithi026.stderr:problem writing to /var/log/ceph/ceph-mon.c.log: (28) No space left on device 2020-04-28T15:03:52.717 INFO:tasks.ceph.mon.a.smithi026.stderr:problem writing to /var/log/ceph/ceph-mon.a.log: (28) No space left on device 2020-04-28T15:03:53.144 INFO:tasks.ceph.mgr.y.smithi026.stderr:problem writing to /var/log/ceph/ceph-mgr.y.log: (28) No space left on device 2020-04-28T15:09:50.873 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T15:09:50.871+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T15:14:25.402 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T15:14:25.400+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T15:30:40.858 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T15:30:40.856+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T15:38:06.781 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T15:38:06.778+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T15:44:44.223 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T15:44:44.221+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T15:46:28.469 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T15:46:28.467+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T15:46:28.469 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T15:46:28.467+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T15:51:00.921 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T15:51:00.918+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T15:51:17.896 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T15:51:17.893+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T15:51:17.896 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T15:51:17.893+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T15:51:30.372 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T15:51:30.370+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T15:55:36.178 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T15:55:36.176+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T16:01:38.459 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:01:38.457+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:02:07.275 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T16:02:07.273+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T16:04:39.573 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:04:39.570+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:04:45.202 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T16:04:45.200+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T16:04:45.203 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T16:04:45.200+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T16:08:17.388 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T16:08:17.385+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T16:09:46.063 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T16:09:46.057+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T16:15:55.539 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T16:15:55.537+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T16:20:04.902 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T16:20:04.900+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T16:22:16.901 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T16:22:16.897+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T16:22:16.902 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T16:22:16.897+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T16:22:20.997 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T16:22:20.993+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T16:27:05.704 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T16:27:05.702+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T16:34:57.172 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T16:34:57.168+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T16:34:57.172 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T16:34:57.168+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T16:34:59.080 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:34:59.077+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:35:02.352 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:35:02.348+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:40:06.747 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:40:06.740+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:42:59.925 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T16:42:59.921+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T16:45:36.619 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:45:36.615+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:46:23.878 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:46:23.873+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:48:17.380 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T16:48:17.377+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T16:48:17.380 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T16:48:17.377+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T16:49:44.235 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T16:49:44.232+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T16:49:44.235 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T16:49:44.232+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T16:50:49.059 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:50:49.056+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T16:57:34.330 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T16:57:34.327+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T16:58:44.730 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T16:58:44.726+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T17:02:38.265 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:02:38.262+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T17:02:38.265 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:02:38.262+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T17:04:02.056 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T17:04:02.052+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T17:04:59.497 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T17:04:59.492+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T17:09:37.998 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:09:37.996+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T17:09:37.998 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:09:37.996+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T17:09:41.866 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T17:09:41.857+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T17:10:09.200 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T17:10:09.197+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T17:12:50.795 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T17:12:50.792+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T17:13:00.811 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T17:13:00.809+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T17:17:56.288 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T17:17:56.286+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T17:27:06.861 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T17:27:06.859+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T17:27:16.878 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T17:27:16.877+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T17:28:45.392 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T17:28:45.391+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T17:33:32.432 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T17:33:32.429+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T17:33:38.852 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T17:33:38.849+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T17:34:10.975 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:34:10.973+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T17:34:10.975 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:34:10.973+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T17:35:12.549 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T17:35:12.548+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T17:36:34.911 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T17:36:34.910+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T17:44:45.950 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:44:45.948+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T17:44:45.950 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:44:45.948+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T17:52:20.055 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T17:52:20.053+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T17:53:10.583 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:53:10.581+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T17:53:10.584 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:53:10.581+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T17:55:47.421 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T17:55:47.419+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T18:07:42.492 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T18:07:42.490+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T18:11:46.552 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T18:11:46.550+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T18:11:46.553 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T18:11:46.551+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T18:11:57.662 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T18:11:57.659+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T18:12:44.265 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T18:12:44.262+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T18:14:01.182 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T18:14:01.180+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T18:22:31.918 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T18:22:31.916+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T18:23:42.180 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T18:23:42.177+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T18:37:02.286 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T18:37:02.282+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T18:38:01.438 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T18:38:01.436+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T18:38:25.997 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T18:38:25.996+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T18:39:40.564 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T18:39:40.562+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T18:43:25.476 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T18:43:25.474+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T19:00:54.405 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T19:00:54.402+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T19:00:58.244 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T19:00:58.241+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T19:31:07.369 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T19:31:07.366+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T19:34:02.104 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T19:34:02.100+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T19:35:19.663 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T19:35:19.661+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T19:42:10.008 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T19:42:10.005+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T19:43:19.087 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T19:43:19.085+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T19:46:58.237 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T19:46:58.232+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T19:51:00.075 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T19:51:00.067+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T19:56:14.877 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T19:56:14.872+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T19:58:02.073 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T19:58:02.070+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T20:01:13.310 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T20:01:13.307+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T20:09:38.511 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:09:38.508+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T20:09:38.531 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:09:38.510+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T20:09:40.362 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:09:40.358+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T20:09:40.362 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:09:40.358+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T20:20:07.328 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T20:20:07.326+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T20:24:18.179 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T20:24:18.177+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T20:25:31.468 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T20:25:31.466+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T20:30:37.177 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:30:37.175+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T20:30:37.179 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:30:37.176+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T20:34:13.106 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T20:34:13.103+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T20:34:13.106 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T20:34:13.103+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T20:35:29.148 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T20:35:29.146+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T20:37:43.102 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T20:37:43.098+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T20:40:30.905 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T20:40:30.903+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T20:41:18.644 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:41:18.640+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T20:41:18.644 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T20:41:18.640+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T20:52:04.415 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T20:52:04.413+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T20:55:06.957 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T20:55:06.953+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T20:56:54.446 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T20:56:54.443+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T20:57:59.107 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T20:57:59.103+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T21:02:14.760 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T21:02:14.758+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T21:06:18.498 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T21:06:18.493+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T21:06:18.499 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T21:06:18.493+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T21:06:29.729 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T21:06:29.727+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T21:13:01.992 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T21:13:01.989+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T21:20:32.409 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T21:20:32.404+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T21:23:43.919 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T21:23:43.917+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T21:24:57.560 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T21:24:57.556+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T21:28:38.799 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T21:28:38.798+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T21:30:01.297 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T21:30:01.293+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T21:34:49.100 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T21:34:49.097+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T21:37:15.195 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T21:37:15.192+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T21:48:30.079 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T21:48:30.077+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T21:56:15.131 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T21:56:15.129+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T22:04:04.160 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T22:04:04.151+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T22:07:59.387 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T22:07:59.383+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T22:09:47.399 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T22:09:47.396+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T22:11:05.691 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T22:11:05.688+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T22:14:49.568 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T22:14:49.566+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T22:15:49.466 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T22:15:49.463+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T22:33:26.432 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T22:33:26.429+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T22:34:36.997 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T22:34:36.994+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T22:39:38.050 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T22:39:38.047+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T22:41:47.530 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T22:41:47.526+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T22:41:47.530 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T22:41:47.526+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T22:42:17.688 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T22:42:17.685+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T22:46:10.646 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T22:46:10.644+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T22:49:55.009 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T22:49:55.007+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T22:49:55.009 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T22:49:55.007+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T22:53:17.191 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T22:53:17.187+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T22:54:50.176 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T22:54:50.175+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T22:56:53.850 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T22:56:53.845+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T22:58:08.087 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T22:58:08.085+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T22:59:54.248 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T22:59:54.246+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T23:01:44.379 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T23:01:44.375+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T23:06:07.437 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:06:07.431+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T23:06:07.438 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:06:07.432+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T23:07:59.780 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T23:07:59.776+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T23:09:03.668 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:09:03.664+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T23:09:03.668 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:09:03.664+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T23:09:06.254 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:09:06.251+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T23:09:06.254 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:09:06.251+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T23:12:13.206 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T23:12:13.204+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T23:13:42.496 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-28T23:13:42.493+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-28T23:21:32.759 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T23:21:32.750+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T23:23:30.468 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T23:23:30.466+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T23:23:35.679 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T23:23:35.676+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T23:24:23.432 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T23:24:23.430+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T23:25:24.907 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T23:25:24.905+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T23:25:24.908 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T23:25:24.906+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T23:39:40.225 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T23:39:40.222+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T23:39:46.616 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-28T23:39:46.615+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-28T23:45:34.271 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T23:45:34.266+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-28T23:45:34.295 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-28T23:45:34.266+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-28T23:46:04.465 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T23:46:04.461+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T23:47:12.863 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:47:12.860+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-28T23:47:12.863 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-28T23:47:12.860+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-28T23:49:46.160 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-28T23:49:46.158+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-28T23:59:11.859 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T23:59:11.856+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-28T23:59:13.752 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-28T23:59:13.750+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-29T00:02:07.970 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-29T00:02:07.968+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-29T00:03:18.289 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-29T00:03:18.288+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-29T00:05:48.445 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-29T00:05:48.439+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-29T00:05:48.445 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-29T00:05:48.439+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-29T00:07:59.586 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-29T00:07:59.582+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-29T00:08:23.285 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-29T00:08:23.283+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-29T00:16:42.321 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-29T00:16:42.319+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-29T00:18:31.344 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-29T00:18:31.341+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-29T00:19:27.595 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-29T00:19:27.593+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-29T00:19:27.596 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-29T00:19:27.593+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-29T00:22:45.938 INFO:tasks.ceph.osd.0.smithi026.stderr:2020-04-29T00:22:45.932+0000 7fd2ab510700 -1 reset not still connected to 0x55dc582d44e0 2020-04-29T00:28:18.871 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-29T00:28:18.870+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-29T00:28:46.910 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-29T00:28:46.907+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-29T00:29:12.803 INFO:tasks.ceph.osd.5.smithi107.stderr:2020-04-29T00:29:12.800+0000 7f39f6347700 -1 reset not still connected to 0x5622e72a2b60 2020-04-29T00:29:26.512 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-29T00:29:26.508+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-29T00:32:03.354 INFO:tasks.ceph.osd.2.smithi026.stderr:2020-04-29T00:32:03.352+0000 7f466c810700 -1 reset not still connected to 0x55ec3063cc30 2020-04-29T00:33:30.325 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-29T00:33:30.321+0000 7f2bd6af1700 -1 reset not still connected to 0x5639239925b0 2020-04-29T00:33:30.325 INFO:tasks.ceph.osd.3.smithi026.stderr:2020-04-29T00:33:30.321+0000 7f2bd6af1700 -1 reset not still connected to 0x563923992b60 2020-04-29T00:34:11.814 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-29T00:34:11.807+0000 7f75e7636700 -1 reset not still connected to 0x55bc52c6e8f0 2020-04-29T00:34:11.814 INFO:tasks.ceph.osd.6.smithi107.stderr:2020-04-29T00:34:11.807+0000 7f75e7636700 -1 reset not still connected to 0x55bc59d73c70 2020-04-29T00:35:47.865 INFO:tasks.ceph.osd.7.smithi107.stderr:2020-04-29T00:35:47.861+0000 7f0fe3981700 -1 reset not still connected to 0x55799ee93ba0 2020-04-29T00:37:22.304 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-04-29T00:37:22.304 DEBUG:teuthology.task.console_log:Killing console logger for smithi107 2020-04-29T00:37:22.305 DEBUG:teuthology.task.console_log:Killing console logger for smithi026 2020-04-29T00:37:22.305 DEBUG:teuthology.task.console_log:Killing console logger for smithi107 2020-04-29T00:37:22.305 DEBUG:teuthology.task.console_log:Killing console logger for smithi026 2020-04-29T00:37:22.306 DEBUG:teuthology.exit:Finished running handlers